Jul 08 11:05:02 devstack cinder-volume[75950]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 11:05:02 devstack cinder-volume[75950]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 11:05:02 devstack cinder-volume[75950]: we strongly recommend against using it for new projects. Jul 08 11:05:02 devstack cinder-volume[75950]: If you are already using Eventlet, we recommend migrating to a different Jul 08 11:05:02 devstack cinder-volume[75950]: framework. For more detail see Jul 08 11:05:02 devstack cinder-volume[75950]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 11:05:02 devstack cinder-volume[75950]: import eventlet # noqa Jul 08 11:05:05 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:05:05 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:05:05 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:05:06 devstack cinder-volume[75950]: INFO dbcounter [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Registered counter for database cinder Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG oslo_db.sqlalchemy.engines [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG dbcounter [-] [75950] Writer thread running {{(pid=75950) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:05:06 devstack cinder-volume[75950]: INFO cinder.rpc [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 11:05:06 devstack cinder-volume[75950]: INFO cinder.rpc [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG oslo_db.sqlalchemy.engines [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:05:06 devstack cinder-volume[75950]: INFO cinder.volume.manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Determined volume DB was empty at startup. Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG cinder.volume.manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75950) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 11:05:06 devstack cinder-volume[75950]: INFO cinder.volume.manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 11:05:06 devstack cinder-volume[75950]: WARNING stevedore.named [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 11:05:06 devstack cinder-volume[75950]: WARNING castellan.key_manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:05:06 devstack cinder-volume[75950]: WARNING cinder.keymgr.conf_key_mgr [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG cinder.volume.drivers.lvm [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75950) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 11:05:06 devstack cinder-volume[75950]: DEBUG oslo_concurrency.processutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75950) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_concurrency.processutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] CMD "cinder-rtstool verify" returned: 0 in 0.585s {{(pid=75950) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_db.sqlalchemy.engines [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:05:07 devstack cinder-volume[75950]: INFO cinder.rpc [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 11:05:07 devstack cinder-volume[75950]: INFO cinder.rpc [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 11:05:07 devstack cinder-volume[75950]: WARNING stevedore.named [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 11:05:07 devstack cinder-volume[75950]: WARNING castellan.key_manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:05:07 devstack cinder-volume[75950]: INFO cinder.volume.manager [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_db.sqlalchemy.engines [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:05:07 devstack cinder-volume[75950]: INFO oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Starting 1 workers Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Started child 76121 {{(pid=75950) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Full set of CONF: {{(pid=75950) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] ******************************************************************************** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Configuration options gathered from: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] ================================================================================ {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] allow_availability_zone_fallback = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] allow_compression_on_image_upload = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] allowed_direct_url_schemes = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] api_rate_limit = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] auth_strategy = keystone {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[76121]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] az_cache_duration = 3600 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_availability_zone = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_host = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_stats_polling_interval = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backup_api_class = cinder.backup.api.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backup_name_template = backup-%s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backup_use_same_host = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backup_use_temp_snapshot = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] chap_password = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] chap_username = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_internal_tenant_project_id = c95da08560ff4ea9bb2dae37b3d2061d {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_internal_tenant_user_id = 47ef03d667064c70bbee4f60096fb50b {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cloned_volume_same_az = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cluster = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] compression_format = gzip {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] compute_api_class = cinder.compute.nova.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] config_dir = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] config_source = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] control_exchange = openstack {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] debug = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] default_availability_zone = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] default_group_type = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] default_volume_type = lvmdriver-1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] disk_geometry = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_client_cert = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_client_cert_key = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_data_namespace = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_ssl_cert_path = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_ssl_cert_verify = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] driver_use_ssl = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] enable_force_upload = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] enable_new_services = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] enable_unsupported_driver = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] enforce_multipath_for_image_xfer = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] filter_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_api_insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_api_ssl_compression = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_ca_certificates_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_catalog_info = image:glance:publicURL {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_num_retries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance_request_timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] goodness_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] graceful_shutdown_timeout = 5 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] group_api_class = cinder.group.api.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] host = devstack {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_compress_on_upload = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_conversion_address_space_limit = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_conversion_cpu_limit = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_conversion_disable = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_upload_use_cinder_backend = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_upload_use_internal_tenant = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_volume_cache_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_volume_cache_max_count = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] image_volume_cache_max_size_gb = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] init_host_max_objects_retrieval = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] instance_format = [instance: %(uuid)s] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iscsi_target_flags = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iscsi_write_cache = on {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iser_helper = tgtadm {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iser_ip_address = 192.168.122.180 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iser_port = 3260 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_color = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_config_append = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_dir = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_options = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_rotate_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_rotate_interval_type = days {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] log_rotation_type = none {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] max_age = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] max_logfile_count = 30 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] max_logfile_size_mb = 200 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] max_over_subscription_ratio = 20.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] message_reap_interval = 86400 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] message_ttl = 2592000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] migration_create_volume_timeout_secs = 300 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] monkey_patch = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] monkey_patch_modules = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] my_ip = 192.168.122.180 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] no_snapshot_gb_quota = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] num_iser_scan_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] num_shell_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] num_volume_device_scan_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] nvmeof_conn_info_version = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] nvmet_ns_id = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] nvmet_port_id = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_max_limit = 1000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_ext_list = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_listen_port = 8776 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_use_ssl = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] osapi_volume_workers = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] per_volume_size_limit = -1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] periodic_fuzzy_delay = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] periodic_interval = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] public_endpoint = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] publish_errors = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_backup_gigabytes = 1000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_backups = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_gigabytes = 1000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_groups = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_snapshots = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] quota_volumes = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] rate_limit_burst = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] rate_limit_except_level = CRITICAL {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] rate_limit_interval = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] reinit_driver_count = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] replication_device = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] report_discard_supported = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] report_interval = 120 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] reservation_clean_interval = 86400 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] reservation_expire = 86400 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] reserved_image_namespaces = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] reserved_percentage = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] rpc_response_timeout = 120 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] run_external_periodic_tasks = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] scst_target_driver = iscsi {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] scst_target_iqn_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_down_time = 720 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] shell_completion = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] snapshot_name_template = snapshot-%s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] snapshot_same_host = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] split_loggers = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] state_path = /opt/stack/data/cinder {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] storage_availability_zone = nova {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] storage_protocol = iSCSI {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] syslog_log_facility = LOG_USER {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_helper = lioadm {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_ip_address = 192.168.122.180 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_port = 3260 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_protocol = iscsi {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] target_secondary_ip_addresses = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] trace_flags = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] transport_url = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] until_refresh = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_chap_auth = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_default_quota_class = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_journal = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_json = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_multipath_for_image_xfer = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_stderr = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] use_syslog = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] verify_glance_signatures = enabled {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_api_class = cinder.volume.api.API {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_backend_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_clear = zero {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_clear_ionice = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_clear_size = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_copy_bps_limit = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_dd_blocksize = 1M {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_name_template = volume-%s {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_service_inithost_offload = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volume_usage_audit_period = month {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] zoning_mode = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_concurrency.disable_process_locking = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.auth_section = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.auth_type = password {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.auth_version = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.cache = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.include_service_catalog = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.interface = public {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_password = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcache_username = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.region_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.service_type = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.backend = dogpile.cache.null {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.backend_argument = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.backend_expiration_time = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.config_prefix = cache.oslo {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.debug_cache_backend = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.enable_retry_client = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.enable_socket_keepalive = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.expiration_time = 600 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.hashclient_retry_attempts = 2 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_dead_retry = 300 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_pool_maxsize = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_sasl_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.password = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.proxies = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.redis_db = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.redis_server = localhost:6379 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.retry_attempts = 2 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.retry_delay = 0.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.socket_keepalive_count = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.socket_keepalive_idle = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.socket_keepalive_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.socket_timeout = 1.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.tls_allowed_ciphers = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.tls_cafile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.tls_certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.tls_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.tls_keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cache.username = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] coordination.backend_url = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.asyncio_connection = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.asyncio_slave_connection = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.backend = sqlalchemy {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.connection = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.connection_debug = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.connection_parameters = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.connection_recycle_time = 3600 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.connection_trace = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.db_inc_retry_interval = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.db_max_retries = 20 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.db_max_retry_interval = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.db_retry_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.max_overflow = 50 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.max_pool_size = 5 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.max_retries = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.mysql_wsrep_sync_wait = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.pool_timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.retry_interval = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.slave_connection = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.sqlite_synchronous = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.synchronous_reader = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] database.use_db_reconnect = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.connection_string = messaging:// {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.es_doc_type = notification {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.es_scroll_size = 10000 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.es_scroll_time = 2m {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.filter_error_trace = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.hmac_keys = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.sentinel_service_name = mymaster {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.socket_timeout = 0.1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.trace_requests = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler.trace_sqlalchemy = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler_jaeger.process_tags = {} {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler_jaeger.service_name_prefix = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] profiler_otlp.service_name_prefix = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.enforce_new_defaults = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.enforce_scope = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.policy_default_rule = default {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.policy_file = policy.yaml {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.group = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.helper_command = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] privsep_osbrick.user = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.group = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.helper_command = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] cinder_sys_admin.user = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.auth_section = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.auth_type = password {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.cafile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.collect_timing = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.send_service_user_token = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.split_loggers = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] service_user.timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.auth_section = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.auth_type = password {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.collect_timing = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.region_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.split_loggers = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] glance.timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.backend_availability_zone = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.chap_password = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.chap_username = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.disk_geometry = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_client_cert = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_client_cert_key = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_data_namespace = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.driver_use_ssl = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.extra_capabilities = {} {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.filter_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.goodness_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iscsi_target_flags = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iscsi_write_cache = on {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iser_helper = tgtadm {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iser_port = 3260 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.lvm_share_target = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.lvm_type = auto {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.num_shell_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.replication_device = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.report_discard_supported = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.reserved_percentage = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_helper = tgtadm {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_port = 3260 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_protocol = iscsi {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.trace_flags = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.unique_fqdn_network = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.use_chap_auth = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_backend_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_clear = zero {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_clear_ionice = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_clear_size = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_reports.file_event_handler = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_reports.log_dir = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.backend_host = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.chap_password = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.chap_username = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.disk_geometry = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_client_cert = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.extra_capabilities = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.filter_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.goodness_function = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iser_helper = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iser_ip_address = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iser_port = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.lvm_share_target = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.lvm_type = auto {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.num_shell_tries = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.replication_device = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.report_discard_supported = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.reserved_percentage = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.scst_target_driver = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.storage_protocol = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_helper = lioadm {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_ip_address = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_port = 3260 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.trace_flags = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack sudo[76125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 11:05:07 devstack sudo[76125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.use_chap_auth = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_clear = zero {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_clear_size = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] lvmdriver-1.volumes_dir = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_notifications.driver = [] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_notifications.retry = -1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] key_manager.fixed_key = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.barbican_api_version = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.barbican_endpoint = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.barbican_endpoint_type = public {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.barbican_region_name = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.cafile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.collect_timing = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.number_of_retries = 60 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.retry_delay = 1 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.send_service_user_token = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.split_loggers = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.verify_ssl = True {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican.verify_ssl_path = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.auth_section = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.auth_type = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.cafile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.certfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.collect_timing = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.insecure = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.keyfile = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:07 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.split_loggers = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] barbican_service_user.timeout = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.approle_role_id = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.approle_secret_id = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.kv_mountpoint = secret {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.kv_path = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.kv_version = 2 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.namespace = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.root_token_id = **** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.ssl_ca_crt_file = None {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.timeout = 60.0 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.use_ssl = False {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:05:08 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] ******************************************************************************** {{(pid=75950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 11:05:08 devstack sudo[76125]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:08 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:08 devstack sudo[76234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:08 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:09 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.654s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:05:09 devstack cinder-volume[76121]: INFO cinder.brick.local_dev.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:09 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:09 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:09 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:09 devstack cinder-volume[76121]: DEBUG cinder.brick.local_dev.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76121) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 11:05:10 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:10 devstack sudo[76687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:10 devstack sudo[76687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:11 devstack sudo[76687]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.162s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:11 devstack sudo[76860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:11 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:11 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:11 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:11 devstack sudo[76903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 11:05:11 devstack sudo[76903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:12 devstack sudo[76903]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:12 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.676s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:12 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:12 devstack sudo[76908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:12 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:13 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:13 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:13 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:13 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:14 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:14 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:14 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:14 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:14 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:14 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:14 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:14 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:14 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:14 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:15 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:15 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:15 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:15 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:15 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:15 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:15 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:16 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:16 devstack cinder-volume[76121]: INFO cinder.volume.drivers.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:16 devstack sudo[76979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:16 devstack sudo[76979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:16 devstack sudo[76979]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:05:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:16 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:16 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:17 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:17 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:17 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:17 devstack cinder-volume[75950]: DEBUG dbcounter [-] [75950] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75950) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:05:18 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:18 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:18 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:19 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.619s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:19 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:19 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:19 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:19 devstack cinder-volume[76121]: INFO cinder.volume.driver [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Driver hasn't implemented _init_vendor_properties() Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG cinder.volume.driver [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76121) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG oslo_db.sqlalchemy.engines [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76121) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writer thread running {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG cinder.db.api [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Building query based on filter {{(pid=76121) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG cinder.image.image_utils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76121) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 11:05:19 devstack cinder-volume[76121]: INFO cinder.keymgr.migration [None req-4573501d-89a1-470c-88fe-2f1547a47104 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:05:19 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:19 devstack sudo[77253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:19 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:20 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:20 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:20 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:20 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:20 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:21 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:21 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:21 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:21 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:21 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:21 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:21 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:21 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:21 devstack sudo[77267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:21 devstack sudo[77267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:22 devstack sudo[77267]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:05:22 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Driver initialization completed successfully. Jul 08 11:05:22 devstack cinder-volume[76121]: INFO cinder.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Initiating service 2 cleanup Jul 08 11:05:22 devstack cinder-volume[76121]: INFO cinder.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Service 2 cleanup completed. Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG cinder.service [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Creating RPC server for service cinder-volume {{(pid=76121) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG cinder.service [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76121) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 11:05:22 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:05:22 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:22 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:05:22 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:23 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:23 devstack sudo[77275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:23 devstack sudo[77275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:23 devstack sudo[77275]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:23 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:23 devstack sudo[77278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:05:23 devstack sudo[77278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:24 devstack sudo[77278]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:24 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:05:24 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:05:24 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:05:25 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Jul 08 11:05:25 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:05:25 devstack cinder-volume[76121]: INFO cinder.volume.manager [None req-355d3703-c664-4ea6-a44b-38acbd76664d None None] Driver post RPC initialization completed successfully. Jul 08 11:05:35 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:05:35 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:06:16 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:06:16 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:06:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:16 devstack sudo[78994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:06:16 devstack sudo[78994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:16 devstack sudo[78994]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:16 devstack sudo[78997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:06:16 devstack sudo[78997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:17 devstack sudo[78997]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:17 devstack sudo[79008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:06:17 devstack sudo[79008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:18 devstack sudo[79008]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:06:18 devstack sudo[79035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:06:18 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:06:18 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:06:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread info: [<_MainThread(MainThread, started 137060776919168)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:07:16 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:07:16 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:07:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:07:16 devstack sudo[82295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:07:16 devstack sudo[82295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:07:16 devstack sudo[82295]: pam_unix(sudo:session): session closed for user root Jul 08 11:07:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:07:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:07:16 devstack sudo[82299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:07:16 devstack sudo[82299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:07:17 devstack sudo[82299]: pam_unix(sudo:session): session closed for user root Jul 08 11:07:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:07:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:07:17 devstack sudo[82303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:07:17 devstack sudo[82303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:07:18 devstack sudo[82303]: pam_unix(sudo:session): session closed for user root Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:07:18 devstack sudo[82308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:07:18 devstack sudo[82308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:07:18 devstack sudo[82308]: pam_unix(sudo:session): session closed for user root Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:07:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread info: [<_MainThread(MainThread, started 137060776919168)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:07:35 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:08:16 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:08:16 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:08:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:08:16 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:08:16 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:08:16 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Jul 08 11:08:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:08:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:08:16 devstack sudo[84226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:08:16 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:08:17 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root Jul 08 11:08:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:08:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:08:17 devstack sudo[84243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:08:17 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:08:18 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root Jul 08 11:08:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:08:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:08:18 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:08:18 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:08:19 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Jul 08 11:08:19 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:08:19 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:09:16 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:09:16 devstack cinder-volume[76121]: DEBUG cinder.volume.drivers.lvm [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Updating volume stats {{(pid=76121) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 11:09:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:16 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 11:09:16 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:16 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:16 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:16 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:09:16 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:17 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:17 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:17 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 11:09:17 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:18 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:18 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 11:09:18 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:18 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG oslo_concurrency.processutils [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76121) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG cinder.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Notifying Schedulers of capabilities ... {{(pid=76121) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG oslo_service.periodic_task [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] Running periodic task VolumeManager._thread_info {{(pid=76121) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread count: 6 {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:09:18 devstack cinder-volume[76121]: DEBUG cinder.volume.manager [None req-188252ea-f165-461f-bb8b-2e7b0b707631 None None] thread info: [<_MainThread(MainThread, started 137060776919168)>, , , , , ] {{(pid=76121) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:09:35 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:SELECT=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:09:35 devstack cinder-volume[76121]: DEBUG dbcounter [-] [76121] Writing DB stats cinder:UPDATE=1 {{(pid=76121) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:09:45 devstack cinder-volume[75950]: INFO oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Caught SIGTERM, stopping children Jul 08 11:09:45 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Acquiring lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:45 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Acquired lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:45 devstack cinder-volume[75950]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Releasing lock "singleton_lock" {{(pid=75950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:09:45 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Stop services. {{(pid=75950) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 11:09:45 devstack cinder-volume[75950]: DEBUG oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Killing children. {{(pid=75950) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 11:09:45 devstack cinder-volume[75950]: INFO oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Waiting on 1 children to exit Jul 08 11:09:47 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Acquiring lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:47 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Acquired lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:47 devstack cinder-volume[76121]: DEBUG oslo_concurrency.lockutils [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Releasing lock "singleton_lock" {{(pid=76121) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:09:47 devstack cinder-volume[76121]: WARNING amqp [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 11:09:47 devstack cinder-volume[76121]: WARNING amqp [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 11:09:47 devstack cinder-volume[75950]: INFO oslo_service.backend._eventlet.service [None req-1105bb4c-1e27-45b1-ba90-d8251b17cb2c None None] Child 76121 exited with status 0 Jul 08 11:09:47 devstack cinder-volume[86249]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 11:09:47 devstack cinder-volume[86249]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 11:09:47 devstack cinder-volume[86249]: we strongly recommend against using it for new projects. Jul 08 11:09:47 devstack cinder-volume[86249]: If you are already using Eventlet, we recommend migrating to a different Jul 08 11:09:47 devstack cinder-volume[86249]: framework. For more detail see Jul 08 11:09:47 devstack cinder-volume[86249]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 11:09:47 devstack cinder-volume[86249]: import eventlet # noqa Jul 08 11:09:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:50 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:09:50 devstack cinder-volume[86249]: INFO dbcounter [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Registered counter for database cinder Jul 08 11:09:50 devstack cinder-volume[86249]: DEBUG oslo_db.sqlalchemy.engines [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86249) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG dbcounter [-] [86249] Writer thread running {{(pid=86249) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:09:51 devstack cinder-volume[86249]: INFO cinder.rpc [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 11:09:51 devstack cinder-volume[86249]: INFO cinder.rpc [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_db.sqlalchemy.engines [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86249) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:09:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Determined volume DB was empty at startup. Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG cinder.volume.manager [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86249) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 11:09:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 11:09:51 devstack cinder-volume[86249]: WARNING stevedore.named [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 11:09:51 devstack cinder-volume[86249]: WARNING castellan.key_manager [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:09:51 devstack cinder-volume[86249]: WARNING cinder.keymgr.conf_key_mgr [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:09:51 devstack cinder-volume[86249]: INFO cinder.volume.manager [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_db.sqlalchemy.engines [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86249) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:09:51 devstack cinder-volume[86249]: INFO oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Starting 1 workers Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Started child 86469 {{(pid=86249) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Full set of CONF: {{(pid=86249) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] ******************************************************************************** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Configuration options gathered from: {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 11:09:51 devstack cinder-volume[86469]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] ================================================================================ {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] allow_availability_zone_fallback = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] allow_compression_on_image_upload = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] allowed_direct_url_schemes = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] api_rate_limit = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] auth_strategy = keystone {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_availability_zone = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_host = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_stats_polling_interval = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backup_api_class = cinder.backup.api.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backup_name_template = backup-%s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backup_use_same_host = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backup_use_temp_snapshot = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] chap_password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] chap_username = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_internal_tenant_project_id = c95da08560ff4ea9bb2dae37b3d2061d {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_internal_tenant_user_id = 47ef03d667064c70bbee4f60096fb50b {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cluster = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] compression_format = gzip {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] config_dir = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] config_source = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] control_exchange = openstack {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] debug = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] default_availability_zone = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] default_group_type = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] default_volume_type = QuobyteHD {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] disk_geometry = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_client_cert = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_client_cert_key = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_data_namespace = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_ssl_cert_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_ssl_cert_verify = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] driver_use_ssl = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] enable_new_services = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] enable_unsupported_driver = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] enforce_multipath_for_image_xfer = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] filter_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_api_insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_api_ssl_compression = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_ca_certificates_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_num_retries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance_request_timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] goodness_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] graceful_shutdown_timeout = 5 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] group_api_class = cinder.group.api.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] host = devstack {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_compress_on_upload = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_conversion_address_space_limit = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_conversion_cpu_limit = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_conversion_disable = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_upload_use_cinder_backend = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_upload_use_internal_tenant = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_volume_cache_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_volume_cache_max_count = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] init_host_max_objects_retrieval = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] instance_format = [instance: %(uuid)s] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iscsi_target_flags = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iscsi_write_cache = on {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iser_helper = tgtadm {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iser_ip_address = 192.168.122.180 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iser_port = 3260 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_color = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_config_append = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_dir = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_options = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_rotate_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_rotate_interval_type = days {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] log_rotation_type = none {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] max_age = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] max_logfile_count = 30 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] max_logfile_size_mb = 200 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] max_over_subscription_ratio = 20.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] message_reap_interval = 86400 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] message_ttl = 2592000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] monkey_patch = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] monkey_patch_modules = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] my_ip = 192.168.122.180 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] no_snapshot_gb_quota = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] num_iser_scan_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] num_shell_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] num_volume_device_scan_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] nvmeof_conn_info_version = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] nvmet_ns_id = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] nvmet_port_id = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_max_limit = 1000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_ext_list = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_listen_port = 8776 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_use_ssl = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] osapi_volume_workers = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] per_volume_size_limit = -1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] periodic_fuzzy_delay = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] periodic_interval = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] public_endpoint = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] publish_errors = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_backup_gigabytes = 1000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_backups = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_gigabytes = 1000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_groups = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_snapshots = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] quota_volumes = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] rate_limit_burst = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.remotefs [None req-29052568-9ead-48c3-b314-a019422efa7e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86469) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] rate_limit_except_level = CRITICAL {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] rate_limit_interval = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] reinit_driver_count = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] replication_device = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] report_discard_supported = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] report_interval = 120 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] reservation_clean_interval = 86400 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] reservation_expire = 86400 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] reserved_image_namespaces = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] reserved_percentage = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] rpc_response_timeout = 120 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] run_external_periodic_tasks = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] scst_target_driver = iscsi {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] scst_target_iqn_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_down_time = 720 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] shell_completion = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] snapshot_name_template = snapshot-%s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] split_loggers = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] state_path = /opt/stack/data/cinder {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] storage_availability_zone = nova {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] storage_protocol = iSCSI {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] syslog_log_facility = LOG_USER {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_helper = lioadm {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_ip_address = 192.168.122.180 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_port = 3260 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_protocol = iscsi {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] target_secondary_ip_addresses = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] trace_flags = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] transport_url = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] until_refresh = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_chap_auth = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_default_quota_class = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_journal = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_json = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_multipath_for_image_xfer = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_stderr = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] use_syslog = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] verify_glance_signatures = enabled {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_api_class = cinder.volume.api.API {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_backend_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_clear = zero {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_clear_ionice = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_clear_size = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_copy_bps_limit = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_dd_blocksize = 1M {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_name_template = volume-%s {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_service_inithost_offload = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volume_usage_audit_period = month {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] zoning_mode = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.auth_section = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.auth_type = password {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.auth_version = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.cache = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.interface = public {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_password = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcache_username = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.region_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.service_type = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.backend = dogpile.cache.null {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.backend_argument = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.backend_expiration_time = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.config_prefix = cache.oslo {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.debug_cache_backend = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.enable_retry_client = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.enable_socket_keepalive = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.expiration_time = 600 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_dead_retry = 300 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_sasl_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.proxies = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.redis_db = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.redis_server = localhost:6379 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.retry_attempts = 2 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.retry_delay = 0.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.socket_keepalive_count = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.socket_keepalive_idle = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.socket_keepalive_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.socket_timeout = 1.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.tls_allowed_ciphers = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.tls_cafile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.tls_certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.tls_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.tls_keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cache.username = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] coordination.backend_url = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.asyncio_connection = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.asyncio_slave_connection = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.backend = sqlalchemy {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.connection = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.connection_debug = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.connection_parameters = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.connection_recycle_time = 3600 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.connection_trace = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.db_inc_retry_interval = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.db_max_retries = 20 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.db_max_retry_interval = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.db_retry_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.max_overflow = 50 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.max_pool_size = 5 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.max_retries = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.pool_timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.retry_interval = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.slave_connection = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.sqlite_synchronous = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.synchronous_reader = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] database.use_db_reconnect = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86469) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.connection_string = messaging:// {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.es_doc_type = notification {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.es_scroll_size = 10000 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.es_scroll_time = 2m {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.filter_error_trace = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86469]: WARNING cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.hmac_keys = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.sentinel_service_name = mymaster {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.socket_timeout = 0.1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86469]: WARNING cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Running cmd (subprocess): mount.quobyte {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.trace_requests = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler.trace_sqlalchemy = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler_jaeger.process_tags = {} {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] profiler_otlp.service_name_prefix = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.enforce_scope = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.policy_default_rule = default {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.group = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.helper_command = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] privsep_osbrick.user = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.group = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.helper_command = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] cinder_sys_admin.user = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.auth_section = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.auth_type = password {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.cafile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.collect_timing = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.send_service_user_token = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.split_loggers = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] service_user.timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.auth_section = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.auth_type = password {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.collect_timing = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.region_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.split_loggers = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] glance.timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.backend_availability_zone = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.chap_password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.chap_username = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.disk_geometry = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_client_cert = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_data_namespace = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.driver_use_ssl = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.extra_capabilities = {} {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.filter_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.goodness_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iscsi_target_flags = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iser_port = 3260 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_host = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_login = admin {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_mount_options = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_private_key = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_share_path = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.replication_device = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.report_discard_supported = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_helper = tgtadm {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_port = 3260 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_protocol = iscsi {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.trace_flags = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.use_chap_auth = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_backend_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_clear = zero {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_reports.file_event_handler = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_reports.log_dir = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.backend_host = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.chap_password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.chap_username = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.disk_geometry = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_client_cert = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.extra_capabilities = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.filter_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.goodness_function = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iser_helper = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iser_ip_address = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iser_port = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_host = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_login = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_mount_options = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_password = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_private_key = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_share_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.num_shell_tries = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.replication_device = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.report_discard_supported = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.reserved_percentage = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.scst_target_driver = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.storage_protocol = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_helper = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_ip_address = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_port = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_prefix = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_protocol = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.trace_flags = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.use_chap_auth = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_clear = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_clear_size = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] QuobyteHD.volumes_dir = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_notifications.driver = [] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] key_manager.fixed_key = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.barbican_api_version = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.barbican_endpoint = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.barbican_endpoint_type = public {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.barbican_region_name = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.cafile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.collect_timing = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.number_of_retries = 60 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.retry_delay = 1 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.send_service_user_token = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.split_loggers = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.verify_ssl = True {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican.verify_ssl_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.auth_section = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.auth_type = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.cafile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.certfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.collect_timing = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.insecure = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.keyfile = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.split_loggers = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] barbican_service_user.timeout = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.approle_role_id = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.approle_secret_id = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.kv_mountpoint = secret {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.kv_path = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.kv_version = 2 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.namespace = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.root_token_id = **** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.ssl_ca_crt_file = None {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.timeout = 60.0 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.use_ssl = False {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:09:51 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] ******************************************************************************** {{(pid=86249) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 11:09:51 devstack quobyte-client[86474]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 11:09:51 devstack quobyte-client[86474]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86469) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:09:51 devstack cinder-volume[86469]: INFO cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 ... Jul 08 11:09:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b -c /etc/quobyte/client-cinder.cfg {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:51 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b -c /etc/quobyte/client-cinder.cfg Jul 08 11:09:51 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:52 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:52 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.763s {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:52 devstack cinder-volume[86469]: INFO cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 succeeded Jul 08 11:09:52 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86469) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:09:52 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.775s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:09:52 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:52 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:09:52 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:53 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.664s {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:53 devstack cinder-volume[86469]: INFO cinder.volume.driver [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Driver hasn't implemented _init_vendor_properties() Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG cinder.volume.driver [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7354888916016, 'free_capacity_gb': 1775.7354888916016, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86469) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_db.sqlalchemy.engines [None req-29052568-9ead-48c3-b314-a019422efa7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG dbcounter [-] [86469] Writer thread running {{(pid=86469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG cinder.db.api [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Building query based on filter {{(pid=86469) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG cinder.image.image_utils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86469) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 11:09:53 devstack cinder-volume[86469]: INFO cinder.keymgr.migration [None req-6b1c8bf3-4dd7-41ed-82c7-9d889333199a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86469) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86469) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:09:53 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:53 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:09:53 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:54 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.962s {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG cinder.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Notifying Schedulers of capabilities ... {{(pid=86469) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:09:54 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Driver initialization completed successfully. Jul 08 11:09:54 devstack cinder-volume[86469]: INFO cinder.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Initiating service 3 cleanup Jul 08 11:09:54 devstack cinder-volume[86469]: INFO cinder.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Service 3 cleanup completed. Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG cinder.service [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Creating RPC server for service cinder-volume {{(pid=86469) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG cinder.service [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86469) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 11:09:54 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86469) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG cinder.volume.drivers.quobyte [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86469) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86469) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:09:54 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:09:54 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:09:54 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:09:55 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Jul 08 11:09:55 devstack cinder-volume[86469]: DEBUG oslo_concurrency.processutils [None req-29052568-9ead-48c3-b314-a019422efa7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.104s {{(pid=86469) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:09:55 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-29052568-9ead-48c3-b314-a019422efa7e None None] Driver post RPC initialization completed successfully. Jul 08 11:09:56 devstack cinder-volume[86249]: INFO oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Caught SIGTERM, stopping children Jul 08 11:09:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Acquiring lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Acquired lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:56 devstack cinder-volume[86249]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Releasing lock "singleton_lock" {{(pid=86249) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:09:56 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Stop services. {{(pid=86249) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 11:09:56 devstack cinder-volume[86249]: DEBUG oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Killing children. {{(pid=86249) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 11:09:56 devstack cinder-volume[86249]: INFO oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Waiting on 1 children to exit Jul 08 11:09:56 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Acquiring lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:56 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Acquired lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:56 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Releasing lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:09:56 devstack cinder-volume[86469]: WARNING amqp [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 11:09:56 devstack cinder-volume[86469]: WARNING amqp [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 11:09:56 devstack cinder-volume[86249]: INFO oslo_service.backend._eventlet.service [None req-42becede-57cb-48db-b895-4e7bd5a90df3 None None] Child 86469 exited with status 0 Jul 08 11:09:57 devstack cinder-volume[86773]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 11:09:57 devstack cinder-volume[86773]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 11:09:57 devstack cinder-volume[86773]: we strongly recommend against using it for new projects. Jul 08 11:09:57 devstack cinder-volume[86773]: If you are already using Eventlet, we recommend migrating to a different Jul 08 11:09:57 devstack cinder-volume[86773]: framework. For more detail see Jul 08 11:09:57 devstack cinder-volume[86773]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 11:09:57 devstack cinder-volume[86773]: import eventlet # noqa Jul 08 11:09:59 devstack cinder-volume[86773]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86773) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 11:09:59 devstack cinder-volume[86773]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86773) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 11:09:59 devstack cinder-volume[86773]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86773) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 11:10:00 devstack cinder-volume[86773]: INFO dbcounter [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Registered counter for database cinder Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_db.sqlalchemy.engines [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86773) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG dbcounter [-] [86773] Writer thread running {{(pid=86773) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:10:00 devstack cinder-volume[86773]: INFO cinder.rpc [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 11:10:00 devstack cinder-volume[86773]: INFO cinder.rpc [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_db.sqlalchemy.engines [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86773) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:10:00 devstack cinder-volume[86773]: INFO cinder.volume.manager [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Determined volume DB was empty at startup. Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG cinder.volume.manager [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86773) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 11:10:00 devstack cinder-volume[86773]: WARNING stevedore.named [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 11:10:00 devstack cinder-volume[86773]: WARNING castellan.key_manager [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:10:00 devstack cinder-volume[86773]: WARNING cinder.keymgr.conf_key_mgr [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 11:10:00 devstack cinder-volume[86773]: INFO cinder.volume.manager [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_db.sqlalchemy.engines [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86773) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:10:00 devstack cinder-volume[86773]: INFO oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Starting 1 workers Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Started child 86852 {{(pid=86773) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Full set of CONF: {{(pid=86773) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] ******************************************************************************** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] Configuration options gathered from: {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 11:10:00 devstack cinder-volume[86852]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] ================================================================================ {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] allow_availability_zone_fallback = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] allow_compression_on_image_upload = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] allowed_direct_url_schemes = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] api_rate_limit = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] auth_strategy = keystone {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_availability_zone = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_host = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_stats_polling_interval = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backup_api_class = cinder.backup.api.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backup_name_template = backup-%s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backup_use_same_host = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backup_use_temp_snapshot = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] chap_password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] chap_username = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_internal_tenant_project_id = c95da08560ff4ea9bb2dae37b3d2061d {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_internal_tenant_user_id = 47ef03d667064c70bbee4f60096fb50b {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cluster = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] compression_format = gzip {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] compute_api_class = cinder.compute.nova.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] config_dir = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] config_source = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] control_exchange = openstack {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] debug = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] default_availability_zone = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] default_group_type = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] default_volume_type = QuobyteHD {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] disk_geometry = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_client_cert = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_client_cert_key = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_data_namespace = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_ssl_cert_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_ssl_cert_verify = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] driver_use_ssl = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] enable_new_services = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] enable_unsupported_driver = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] enabled_backends = ['QuobyteHD'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] enforce_multipath_for_image_xfer = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] filter_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_api_insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_api_servers = ['http://192.168.122.180/image'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_api_ssl_compression = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_ca_certificates_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_catalog_info = image:glance:publicURL {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_num_retries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance_request_timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] goodness_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] graceful_shutdown_timeout = 5 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] group_api_class = cinder.group.api.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] host = devstack {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_compress_on_upload = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_conversion_address_space_limit = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_conversion_cpu_limit = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_conversion_disable = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_upload_use_cinder_backend = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_upload_use_internal_tenant = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_volume_cache_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_volume_cache_max_count = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] image_volume_cache_max_size_gb = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] init_host_max_objects_retrieval = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] instance_format = [instance: %(uuid)s] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iscsi_target_flags = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86852) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iscsi_write_cache = on {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iser_helper = tgtadm {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iser_ip_address = 192.168.122.180 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iser_port = 3260 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_color = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_config_append = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_dir = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_options = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_rotate_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_rotate_interval_type = days {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] log_rotation_type = none {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] max_age = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] max_logfile_count = 30 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] max_logfile_size_mb = 200 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] max_over_subscription_ratio = 20.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] message_reap_interval = 86400 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] message_ttl = 2592000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] migration_create_volume_timeout_secs = 300 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] monkey_patch = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] monkey_patch_modules = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] my_ip = 192.168.122.180 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] no_snapshot_gb_quota = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] num_iser_scan_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] num_shell_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] num_volume_device_scan_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] nvmeof_conn_info_version = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] nvmet_ns_id = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] nvmet_port_id = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_max_limit = 1000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_ext_list = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_listen_port = 8776 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_use_ssl = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] osapi_volume_workers = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] per_volume_size_limit = -1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] periodic_fuzzy_delay = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] periodic_interval = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] public_endpoint = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] publish_errors = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_backup_gigabytes = 1000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_backups = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_gigabytes = 1000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_groups = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_snapshots = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] quota_volumes = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] rate_limit_burst = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] rate_limit_except_level = CRITICAL {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] rate_limit_interval = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] reinit_driver_count = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] replication_device = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] report_discard_supported = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] report_interval = 120 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] reservation_clean_interval = 86400 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] reservation_expire = 86400 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] reserved_image_namespaces = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] reserved_percentage = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] rpc_response_timeout = 120 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] run_external_periodic_tasks = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] scst_target_driver = iscsi {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] scst_target_iqn_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_down_time = 720 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] shell_completion = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] snapshot_name_template = snapshot-%s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] split_loggers = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] state_path = /opt/stack/data/cinder {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] storage_availability_zone = nova {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] storage_protocol = iSCSI {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] syslog_log_facility = LOG_USER {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_helper = lioadm {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_ip_address = 192.168.122.180 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_port = 3260 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_protocol = iscsi {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] target_secondary_ip_addresses = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] trace_flags = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] transport_url = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] until_refresh = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_chap_auth = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_default_quota_class = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_journal = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_json = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_multipath_for_image_xfer = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_stderr = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] use_syslog = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] verify_glance_signatures = enabled {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_api_class = cinder.volume.api.API {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_backend_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_clear = zero {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_clear_ionice = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_clear_size = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_copy_bps_limit = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_dd_blocksize = 1M {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_name_template = volume-%s {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_service_inithost_offload = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volume_usage_audit_period = month {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] zoning_mode = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_concurrency.disable_process_locking = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86852) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 11:10:00 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.auth_section = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.auth_type = password {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.auth_version = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.cache = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Running cmd (subprocess): mount.quobyte {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.include_service_catalog = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.interface = public {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_password = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcache_username = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.region_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.service_type = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.backend = dogpile.cache.null {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.backend_argument = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.backend_expiration_time = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.config_prefix = cache.oslo {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.debug_cache_backend = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.enable_retry_client = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.enable_socket_keepalive = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.expiration_time = 600 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.hashclient_retry_attempts = 2 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_dead_retry = 300 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_pool_maxsize = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_sasl_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.proxies = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.redis_db = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.redis_server = localhost:6379 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.retry_attempts = 2 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.retry_delay = 0.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.socket_keepalive_count = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.socket_keepalive_idle = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.socket_keepalive_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.socket_timeout = 1.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.tls_allowed_ciphers = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.tls_cafile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.tls_certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.tls_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.tls_keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cache.username = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] coordination.backend_url = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.asyncio_connection = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.asyncio_slave_connection = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.backend = sqlalchemy {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.connection = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.connection_debug = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.connection_parameters = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.connection_recycle_time = 3600 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.connection_trace = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.db_inc_retry_interval = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.db_max_retries = 20 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.db_max_retry_interval = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.db_retry_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.max_overflow = 50 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.max_pool_size = 5 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.max_retries = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.mysql_wsrep_sync_wait = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.pool_timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.retry_interval = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.slave_connection = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.sqlite_synchronous = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.synchronous_reader = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] database.use_db_reconnect = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.connection_string = messaging:// {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.es_doc_type = notification {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.es_scroll_size = 10000 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.es_scroll_time = 2m {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.filter_error_trace = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.hmac_keys = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.sentinel_service_name = mymaster {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.socket_timeout = 0.1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.trace_requests = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler.trace_sqlalchemy = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler_jaeger.process_tags = {} {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler_jaeger.service_name_prefix = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] profiler_otlp.service_name_prefix = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.enforce_new_defaults = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.enforce_scope = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.policy_default_rule = default {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.policy_file = policy.yaml {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.group = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.helper_command = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] privsep_osbrick.user = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.group = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.helper_command = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] cinder_sys_admin.user = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.auth_section = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.auth_type = password {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.cafile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.collect_timing = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.send_service_user_token = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.split_loggers = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack quobyte-client[86853]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 11:10:00 devstack quobyte-client[86853]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] service_user.timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.auth_section = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.auth_type = password {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.collect_timing = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.region_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.split_loggers = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] glance.timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.backend_availability_zone = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.chap_password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.chap_username = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.disk_geometry = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_client_cert = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_client_cert_key = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_data_namespace = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.driver_use_ssl = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.extra_capabilities = {} {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.filter_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.goodness_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iscsi_target_flags = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iscsi_write_cache = on {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iser_helper = tgtadm {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iser_port = 3260 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_host = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_login = admin {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_mount_options = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_private_key = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_share_path = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.num_shell_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.quobyte_volume_url = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.replication_device = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.report_discard_supported = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.reserved_percentage = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_helper = tgtadm {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:00 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_port = 3260 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_protocol = iscsi {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.trace_flags = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.unique_fqdn_network = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.use_chap_auth = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_backend_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_clear = zero {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_clear_ionice = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_clear_size = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_reports.file_event_handler = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_reports.log_dir = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.backend_availability_zone = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.backend_host = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.chap_password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.chap_username = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.chiscsi_conf = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.disk_geometry = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_client_cert = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_data_namespace = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.driver_use_ssl = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.extra_capabilities = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.filter_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.goodness_function = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iser_helper = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iser_ip_address = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iser_port = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.iser_target_prefix = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_host = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_login = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_mount_options = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_password = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_private_key = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_share_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_ssh_port = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.num_shell_tries = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.nvmet_port_id = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.replication_device = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.report_discard_supported = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.reserved_percentage = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.scst_target_driver = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.storage_protocol = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_helper = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_ip_address = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_port = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_prefix = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_protocol = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.trace_flags = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.use_chap_auth = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_clear = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_clear_size = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] QuobyteHD.volumes_dir = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_notifications.driver = [] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_notifications.retry = -1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] key_manager.fixed_key = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.barbican_api_version = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.barbican_endpoint = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.barbican_endpoint_type = public {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.barbican_region_name = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.cafile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.collect_timing = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.number_of_retries = 60 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.retry_delay = 1 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.send_service_user_token = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.split_loggers = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.verify_ssl = True {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican.verify_ssl_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.auth_section = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.auth_type = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.cafile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.certfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.collect_timing = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.insecure = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.keyfile = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.split_loggers = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] barbican_service_user.timeout = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.approle_role_id = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.approle_secret_id = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.kv_mountpoint = secret {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.kv_path = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.kv_version = 2 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.namespace = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.root_token_id = **** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.ssl_ca_crt_file = None {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.timeout = 60.0 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.use_ssl = False {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 11:10:01 devstack cinder-volume[86773]: DEBUG oslo_service.backend._eventlet.service [None req-339a424e-f5a6-4340-a19f-aa5ff77d709e None None] ******************************************************************************** {{(pid=86773) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 11:10:01 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:10:01 devstack cinder-volume[86852]: INFO cinder.volume.driver [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG cinder.volume.driver [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7354888916016, 'free_capacity_gb': 1775.7354888916016, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86852) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writer thread running {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG cinder.db.api [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Building query based on filter {{(pid=86852) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86852) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:10:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:10:01 devstack cinder-volume[86852]: INFO cinder.keymgr.migration [None req-f97c2976-e936-47a2-bd48-4b819a5f591f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 11:10:01 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:10:01 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:10:02 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.668s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:10:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Driver initialization completed successfully. Jul 08 11:10:02 devstack cinder-volume[86852]: INFO cinder.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Initiating service 3 cleanup Jul 08 11:10:02 devstack cinder-volume[86852]: INFO cinder.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Service 3 cleanup completed. Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG cinder.service [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Creating RPC server for service cinder-volume {{(pid=86852) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG cinder.service [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86852) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 11:10:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:10:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:10:02 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:10:02 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:10:03 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Jul 08 11:10:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.640s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:10:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-70881aad-bf79-4bf1-bf4f-346b82a92a60 None None] Driver post RPC initialization completed successfully. Jul 08 11:10:10 devstack cinder-volume[86773]: DEBUG dbcounter [-] [86773] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86773) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:10:12 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=3 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:10:13 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:10:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:10:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 6 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:10:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:11:52 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:11:52 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:11:52 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.729s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:11:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:11:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:11:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 6 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:11:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:12:13 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:12:13 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:12:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:12:52 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:12:52 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:12:53 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Jul 08 11:12:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.298s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:12:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:12:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:12:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 6 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:12:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Flow 'volume_create_manager' (c9c51e88-1d6b-472e-834c-7de0cb9ec4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ef786-f16f-47e5-9e35-5d2ca24fc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ef786-f16f-47e5-9e35-5d2ca24fc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1039420379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670d2b40f6774d1d99482cd6bd420a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:02Z,use_quota=True,user_id='147a8961242f41e1b6b3b9dad061afaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09931b83-dac7-4bfe-b6d8-5636d014dd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09931b83-dac7-4bfe-b6d8-5636d014dd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73120fcb-f42b-4690-8575-16432ad8fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73120fcb-f42b-4690-8575-16432ad8fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a', 'volume_name': 'volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9eb2c-f516-425a-8b4a-3c428413015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9eb2c-f516-425a-8b4a-3c428413015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a0302a-095e-4830-8a79-49220f67c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Volume 3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a', 'volume_size': 1} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1039420379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670d2b40f6774d1d99482cd6bd420a6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:02Z,use_quota=True,user_id='147a8961242f41e1b6b3b9dad061afaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Creating volume 3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:13:02 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:13:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:02 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a 1073741824 Jul 08 11:13:02 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:04 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a 1073741824" returned: 0 in 2.062s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:04 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a Jul 08 11:13:04 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:05 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" returned: 0 in 1.079s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] <== create_volume: return (3203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.207s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3a0302a-095e-4830-8a79-49220f67c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de6f625-3a81-42aa-a651-ecbec2670872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Volume volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a (3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a): created successfully Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de6f625-3a81-42aa-a651-ecbec2670872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Flow 'volume_create_manager' (c9c51e88-1d6b-472e-834c-7de0cb9ec4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-35bf4707-8d7e-4ddf-a503-77d6a19a71f0 tempest-ServerRescueNegativeTestJSON-1641960888 None] Created volume successfully. Jul 08 11:13:15 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:13:15 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:13:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Acquiring lock "cinder-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:13:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "cinder-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:13:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Acquiring lock "cinder-quobyte-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:13:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "cinder-quobyte-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:13:25 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7arir66b/privsep.sock'] Jul 08 11:13:25 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7arir66b/privsep.sock Jul 08 11:13:25 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 11:13:27 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Flow 'volume_create_manager' (190b2920-ec26-4e92-a380-0e1dc99f8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9916ea41-9e1a-4d0c-848d-a458932e785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9916ea41-9e1a-4d0c-848d-a458932e785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-834713693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc22993-fd6a-451a-b417-315d388a9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e4c11c10974a1eab645fa45aaf83a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:28Z,use_quota=True,user_id='e4d10072906a42e09e3b05d537fb1901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fae21f-0cf3-42bd-a760-4eca17e9fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fae21f-0cf3-42bd-a760-4eca17e9fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbf5a5-d513-4dcc-824e-af6c9e90ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbf5a5-d513-4dcc-824e-af6c9e90ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc22993-fd6a-451a-b417-315d388a9e3f', 'volume_name': 'volume-9cc22993-fd6a-451a-b417-315d388a9e3f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58765f0-1d71-41fc-8cf3-71d51e830a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58765f0-1d71-41fc-8cf3-71d51e830a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97895f59-eb2c-4e19-b2c2-7e8374b51951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:28 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Volume 9cc22993-fd6a-451a-b417-315d388a9e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc22993-fd6a-451a-b417-315d388a9e3f', 'volume_size': 1} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-834713693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc22993-fd6a-451a-b417-315d388a9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9e4c11c10974a1eab645fa45aaf83a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:28Z,use_quota=True,user_id='e4d10072906a42e09e3b05d537fb1901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Creating volume 9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:13:28 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:13:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:28 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f 1073741824 Jul 08 11:13:28 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 11:13:28 devstack cinder-volume[86852]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 11:13:29 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:29 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Spawned new privsep daemon via rootwrap Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Accepted privsep connection to /tmp/tmp7arir66b/privsep.sock {{(pid=86852) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 11:13:29 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 11:13:29 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 11:13:29 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 11:13:29 devstack cinder-volume[86852]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88694 Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace719a5-920a-4d40-8a64-fdfb94b4e696]: (2,) {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da9e628-e56a-43a2-b798-055e3d5bb4ab]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:29 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a Jul 08 11:13:29 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:29 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f 1073741824" returned: 0 in 1.367s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:29 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f Jul 08 11:13:29 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:30 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" returned: 0 in 1.519s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:30 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a Jul 08 11:13:30 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:13:31 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (e9dabe5a-aff2-4dda-9d18-0650ee2134ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c81e7-b1e2-4ac1-a280-b06907276d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f" returned: 0 in 1.767s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] <== create_volume: return (3230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.234s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c81e7-b1e2-4ac1-a280-b06907276d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1367239186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726409f0-f9bb-490d-b7c0-a0bcc239f930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:31Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5043d5-30f9-45a1-9e52-e26f8d10e904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5043d5-30f9-45a1-9e52-e26f8d10e904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8f2c6a-285e-4402-bde2-af2a57fa79c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8f2c6a-285e-4402-bde2-af2a57fa79c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726409f0-f9bb-490d-b7c0-a0bcc239f930', 'volume_name': 'volume-726409f0-f9bb-490d-b7c0-a0bcc239f930', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4820c0fb-1f17-4646-ae1a-d266283bf2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4820c0fb-1f17-4646-ae1a-d266283bf2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d257d8fe-8e42-4194-9838-f1de5d37406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Volume 726409f0-f9bb-490d-b7c0-a0bcc239f930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726409f0-f9bb-490d-b7c0-a0bcc239f930', 'volume_size': 1} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1367239186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726409f0-f9bb-490d-b7c0-a0bcc239f930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:13:31Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Creating volume 726409f0-f9bb-490d-b7c0-a0bcc239f930 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:13:31 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:31 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 1073741824 Jul 08 11:13:31 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97895f59-eb2c-4e19-b2c2-7e8374b51951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc22993-fd6a-451a-b417-315d388a9e3f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53336782-8ccc-4029-9d47-4114b9c21bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Volume volume-9cc22993-fd6a-451a-b417-315d388a9e3f (9cc22993-fd6a-451a-b417-315d388a9e3f): created successfully Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53336782-8ccc-4029-9d47-4114b9c21bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Flow 'volume_create_manager' (190b2920-ec26-4e92-a380-0e1dc99f8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7ca2ddb3-fcd7-40ae-b729-3a7a5798e3d9 tempest-ServerActionsTestOtherA-605180411 None] Created volume successfully. Jul 08 11:13:32 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" returned: 0 in 1.258s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "cinder-quobyte-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a" released by "delete_volume" :: held 6.378s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:13:32 devstack cinder-volume[86852]: WARNING cinder.quota [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:13:32 devstack cinder-volume[86852]: WARNING cinder.quota [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Created reservations ['c0f8b5bf-6e54-4962-9cb1-6f136e4aeafe', '292a697b-066b-4152-9b1d-75f00824d0b1', 'a5eab9fa-ea2f-4ee3-8be7-5c7e398e2de9', '31622d83-85dd-4460-a2e7-f953c4b9b82a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:32 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:13:32 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:33 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:33 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 1073741824" returned: 0 in 1.667s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.182s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:33 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:13:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Deleted volume successfully. Jul 08 11:13:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d20359-34be-4d4c-b1ec-a4830281ed6f tempest-ServerRescueNegativeTestJSON-1641960888 None] Lock "cinder-3d9ef67f-78f2-4068-b3db-10bfbaaa7d8a-delete_volume" released by "delete_volume" :: held 8.036s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:13:33 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 Jul 08 11:13:33 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:34 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930" returned: 0 in 1.076s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] <== create_volume: return (2820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.822s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d257d8fe-8e42-4194-9838-f1de5d37406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726409f0-f9bb-490d-b7c0-a0bcc239f930', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3d4aa8-df9e-4791-af14-114f0eeec403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:13:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Volume volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 (726409f0-f9bb-490d-b7c0-a0bcc239f930): created successfully Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3d4aa8-df9e-4791-af14-114f0eeec403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:13:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (e9dabe5a-aff2-4dda-9d18-0650ee2134ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:13:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bed64766-6e18-40df-84f2-844c029bb3f8 tempest-AttachVolumeTestJSON-1835886493 None] Created volume successfully. Jul 08 11:13:41 devstack cinder-volume[86852]: WARNING py.warnings [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 08 11:13:41 devstack cinder-volume[86852]: .first() Jul 08 11:13:41 devstack cinder-volume[86852]: Jul 08 11:13:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b76fa-2fb4-421c-84ae-470010f4bf0a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:13:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:41 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 Jul 08 11:13:41 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:42 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-726409f0-f9bb-490d-b7c0-a0bcc239f930', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '061e4495-ec97-4089-9fd7-eef38fc64b4d', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:13:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-58a978b4-7c2e-4899-bf37-21db7daa871c req-2cc35a8b-f4de-4c51-9cb3-c12d206991fb tempest-AttachVolumeTestJSON-1835886493 None] attachment_update completed successfully. Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:13:52 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:INSERT=2 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:13:52 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:13:52 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:13:53 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 08 11:13:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.360s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:13:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Flow 'volume_create_manager' (53a78373-ab75-402b-84e0-d441d75fba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209df388-0169-4f27-9ee0-a25637266614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209df388-0169-4f27-9ee0-a25637266614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1883749905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808d6113-ce18-4064-893b-2b916a5826c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42459aa482cd495dbad256b4dc60340a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:05Z,use_quota=True,user_id='fd9f8e5ce42444d7bb57a70f1bd8fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67539a21-68b0-4eb4-902d-3d074929fe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67539a21-68b0-4eb4-902d-3d074929fe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7a1be-c7e5-464a-9557-6b2e881d348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a7a1be-c7e5-464a-9557-6b2e881d348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808d6113-ce18-4064-893b-2b916a5826c8', 'volume_name': 'volume-808d6113-ce18-4064-893b-2b916a5826c8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f85dbc-d791-4795-b069-121a96791133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f85dbc-d791-4795-b069-121a96791133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcf5c3-ba65-4953-8002-3928049cfa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Volume 808d6113-ce18-4064-893b-2b916a5826c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808d6113-ce18-4064-893b-2b916a5826c8', 'volume_size': 1} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1883749905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808d6113-ce18-4064-893b-2b916a5826c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='42459aa482cd495dbad256b4dc60340a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:05Z,use_quota=True,user_id='fd9f8e5ce42444d7bb57a70f1bd8fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Creating volume 808d6113-ce18-4064-893b-2b916a5826c8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:14:04 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:14:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:04 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 1073741824 Jul 08 11:14:04 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:05 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 1073741824" returned: 0 in 1.133s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:06 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 Jul 08 11:14:06 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:06 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8" returned: 0 in 0.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcf5c3-ba65-4953-8002-3928049cfa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808d6113-ce18-4064-893b-2b916a5826c8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d45898-adc2-4113-97b3-e8083fff2c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Volume volume-808d6113-ce18-4064-893b-2b916a5826c8 (808d6113-ce18-4064-893b-2b916a5826c8): created successfully Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d45898-adc2-4113-97b3-e8083fff2c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Flow 'volume_create_manager' (53a78373-ab75-402b-84e0-d441d75fba17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-e8ceddfc-3f7a-4c60-a236-a82398b5150c req-65176a2c-d423-4602-9f34-6743f06b7d5a tempest-VolumesGetTestJSON-2107456124 None] Created volume successfully. Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Acquiring lock "cinder-808d6113-ce18-4064-893b-2b916a5826c8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "cinder-808d6113-ce18-4064-893b-2b916a5826c8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Flow 'volume_create_manager' (2daf5569-89a8-47b2-9611-6e003ae57cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddfa24d-0f6e-4909-abbe-7f16b2e53a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Acquiring lock "cinder-quobyte-808d6113-ce18-4064-893b-2b916a5826c8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddfa24d-0f6e-4909-abbe-7f16b2e53a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-430367097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a487b2-ab04-4520-95a7-c406098bcb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ebb660c8e146e39350f98576fe4ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:07Z,use_quota=True,user_id='8b2708b8f3744b35ba839493e3a79dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e503a1-aa68-4af1-934e-2ef2e5f9b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e503a1-aa68-4af1-934e-2ef2e5f9b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0fd443-424b-47c4-8bfa-8e80a5ac3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0fd443-424b-47c4-8bfa-8e80a5ac3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a487b2-ab04-4520-95a7-c406098bcb08', 'volume_name': 'volume-07a487b2-ab04-4520-95a7-c406098bcb08', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c22b9a8-e609-410f-99c6-a03b25b4c7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c22b9a8-e609-410f-99c6-a03b25b4c7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503a20e2-3b97-4bbf-9ca0-dc72583de12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:07 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Volume 07a487b2-ab04-4520-95a7-c406098bcb08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a487b2-ab04-4520-95a7-c406098bcb08', 'volume_size': 1} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-430367097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a487b2-ab04-4520-95a7-c406098bcb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ebb660c8e146e39350f98576fe4ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:07Z,use_quota=True,user_id='8b2708b8f3744b35ba839493e3a79dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Creating volume 07a487b2-ab04-4520-95a7-c406098bcb08 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:14:07 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "cinder-quobyte-808d6113-ce18-4064-893b-2b916a5826c8" acquired by "delete_volume" :: waited 0.091s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:07 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 1073741824 Jul 08 11:14:07 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f1d69-e1be-473c-b6e1-473b65c342d4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:07 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 Jul 08 11:14:07 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:08 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8" returned: 0 in 0.829s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:08 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:08 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8 Jul 08 11:14:08 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 1073741824" returned: 0 in 0.929s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:08 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 Jul 08 11:14:08 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:09 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-808d6113-ce18-4064-893b-2b916a5826c8" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "cinder-quobyte-808d6113-ce18-4064-893b-2b916a5826c8" released by "delete_volume" :: held 1.607s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.quota [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Created reservations ['0aacdfa4-c25d-4085-afda-626de6c6cfee', '2273150c-c79a-474d-b4ee-1012c93fc8f1', 'e706ab27-7061-4e60-991f-0e53073bddf5', '00d32604-bce0-4565-94c8-52e48ae78041'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:09 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08" returned: 0 in 0.713s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503a20e2-3b97-4bbf-9ca0-dc72583de12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a487b2-ab04-4520-95a7-c406098bcb08', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce4bf37-4ea3-4e35-9959-4ccc58058556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Volume volume-07a487b2-ab04-4520-95a7-c406098bcb08 (07a487b2-ab04-4520-95a7-c406098bcb08): created successfully Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce4bf37-4ea3-4e35-9959-4ccc58058556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Flow 'volume_create_manager' (2daf5569-89a8-47b2-9611-6e003ae57cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-df938990-5476-474c-902c-df9a7863999b tempest-VolumesAdminNegativeTest-801159258 None] Created volume successfully. Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:09 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:09 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Acquiring lock "cinder-07a487b2-ab04-4520-95a7-c406098bcb08-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "cinder-07a487b2-ab04-4520-95a7-c406098bcb08-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Acquiring lock "cinder-quobyte-07a487b2-ab04-4520-95a7-c406098bcb08" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "cinder-quobyte-07a487b2-ab04-4520-95a7-c406098bcb08" acquired by "delete_volume" :: waited 0.047s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9cc2ac-555e-497f-ae9d-7defc2e1c2a4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:10 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG cinder.manager [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Deleted volume successfully. Jul 08 11:14:10 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 Jul 08 11:14:10 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-11a30154-8a30-48d7-8df7-0659e9277ff0 req-3f4814a9-3a20-4597-8002-3095f6311973 tempest-VolumesGetTestJSON-2107456124 None] Lock "cinder-808d6113-ce18-4064-893b-2b916a5826c8-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:11 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08" returned: 0 in 1.394s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:11 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08 Jul 08 11:14:11 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:12 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-07a487b2-ab04-4520-95a7-c406098bcb08" returned: 0 in 0.861s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "cinder-quobyte-07a487b2-ab04-4520-95a7-c406098bcb08" released by "delete_volume" :: held 2.388s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Created reservations ['74055862-decf-4eb6-a03e-e0aaabf66c6f', '51b6bd71-a632-4de5-a808-b1093ca4d8ef', '6af29dab-bcee-4556-8350-8a7284f9f223', '30759079-a698-4b94-9002-49f7a23acb93'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:12 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:12 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:14 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.710s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Deleted volume successfully. Jul 08 11:14:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-362cf89b-9396-4430-a64a-3f6581cdd22d tempest-VolumesAdminNegativeTest-801159258 None] Lock "cinder-07a487b2-ab04-4520-95a7-c406098bcb08-delete_volume" released by "delete_volume" :: held 4.678s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-07e754ce-df60-4c46-81ff-5867a5a4e32b tempest-GroupSnapshotsV319Test-1000825905 None] Group tempest-GroupSnapshotsV319Test-Group-1833609477: creating Jul 08 11:14:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-07e754ce-df60-4c46-81ff-5867a5a4e32b tempest-GroupSnapshotsV319Test-1000825905 None] Group tempest-GroupSnapshotsV319Test-Group-1833609477: created successfully Jul 08 11:14:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-07e754ce-df60-4c46-81ff-5867a5a4e32b tempest-GroupSnapshotsV319Test-1000825905 None] Create group completed successfully. Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Flow 'volume_create_manager' (7d5f0256-430e-46c0-95a2-b432f7026538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5671459c-3338-4208-a001-9622e733db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5671459c-3338-4208-a001-9622e733db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266193899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fb63ca-4a63-4a5f-aecb-e53aa3910642,host='devstack@QuobyteHD#QuobyteHD',id=f1254bd5-9c52-40c5-bafa-075e46064763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689b4477d1e04810b5871f3307a4d326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:18Z,use_quota=True,user_id='f69c6af390e4414faabb8eb924984623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9935df-da08-4d5d-91e9-829729bff8d1),volume_type_id=aa9935df-da08-4d5d-91e9-829729bff8d1)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04819aac-306b-43f7-9df7-ce99882e2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04819aac-306b-43f7-9df7-ce99882e2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbf7ecd-1155-451f-98ae-1c341ce18b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbf7ecd-1155-451f-98ae-1c341ce18b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1254bd5-9c52-40c5-bafa-075e46064763', 'volume_name': 'volume-f1254bd5-9c52-40c5-bafa-075e46064763', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940f9bb-f9d0-4b09-af93-05dedb71e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940f9bb-f9d0-4b09-af93-05dedb71e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd14f13-e871-44ca-92f6-8b4ec4416184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Volume f1254bd5-9c52-40c5-bafa-075e46064763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1254bd5-9c52-40c5-bafa-075e46064763', 'volume_size': 1} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91fb63ca-4a63-4a5f-aecb-e53aa3910642,created_at=2026-07-08T09:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-266193899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fb63ca-4a63-4a5f-aecb-e53aa3910642,host='devstack@QuobyteHD#QuobyteHD',id=f1254bd5-9c52-40c5-bafa-075e46064763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689b4477d1e04810b5871f3307a4d326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:18Z,use_quota=True,user_id='f69c6af390e4414faabb8eb924984623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa9935df-da08-4d5d-91e9-829729bff8d1),volume_type_id=aa9935df-da08-4d5d-91e9-829729bff8d1)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Creating volume f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:14:18 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:14:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:18 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 1073741824 Jul 08 11:14:18 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:19 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 1073741824" returned: 0 in 0.859s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:19 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 Jul 08 11:14:19 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:20 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd14f13-e871-44ca-92f6-8b4ec4416184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1254bd5-9c52-40c5-bafa-075e46064763', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1bbfc0-94aa-4498-8c4f-86d33257f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:20 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Volume volume-f1254bd5-9c52-40c5-bafa-075e46064763 (f1254bd5-9c52-40c5-bafa-075e46064763): created successfully Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1bbfc0-94aa-4498-8c4f-86d33257f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Flow 'volume_create_manager' (7d5f0256-430e-46c0-95a2-b432f7026538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-671acb57-23c9-411b-83db-867f1eef8997 tempest-GroupSnapshotsV319Test-1000825905 None] Created volume successfully. Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af359d-98a1-4197-8e8e-2dc941a881e0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:20 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f Jul 08 11:14:20 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:21 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f" returned: 0 in 0.832s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-9cc22993-fd6a-451a-b417-315d388a9e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c7529a4-cb6c-4f54-8615-29bb2b4e031f', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:14:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-23f0ad4d-b612-49f6-89cb-76e04b13d1d9 req-b855b166-3969-45b4-876b-69c2390ddd20 tempest-ServerActionsTestOtherA-605180411 None] attachment_update completed successfully. Jul 08 11:14:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] GroupSnapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: creating. Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Group snapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: creating. {{(pid=86852) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Creating offline snapshot 1ef2dd4e-fe71-4b1b-950e-701755823372 of volume f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[52664523-fa2b-419e-8e5d-db9c6a845173]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:21 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 Jul 08 11:14:21 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:22 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763" returned: 0 in 0.842s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:22 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 1G Jul 08 11:14:22 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:23 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 1G" returned: 0 in 0.850s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1254bd5-9c52-40c5-bafa-075e46064763 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:23 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1254bd5-9c52-40c5-bafa-075e46064763 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 Jul 08 11:14:23 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:23 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1254bd5-9c52-40c5-bafa-075e46064763 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372" returned: 0 in 0.743s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:23 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:14:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:24 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 Jul 08 11:14:24 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:24 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372" returned: 0 in 0.678s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:24 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info Jul 08 11:14:24 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:25 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info" returned: 0 in 0.767s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:25 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:14:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:25 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info Jul 08 11:14:25 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:26 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.info" returned: 0 in 0.926s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.908s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1899b84d-f4b4-41a1-a0ae-60a31c550c12 tempest-GroupSnapshotsV319Test-1000825905 None] group_snapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: created successfully Jul 08 11:14:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] group_snapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: deleting Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] group_snapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: deleting {{(pid=86852) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "cinder-quobyte-1ef2dd4e-fe71-4b1b-950e-701755823372" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-1ef2dd4e-fe71-4b1b-950e-701755823372" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Deleting offline snapshot 1ef2dd4e-fe71-4b1b-950e-701755823372 of volume f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] snapshot_file for this snap is: volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdedcc0a-1121-44e8-81c4-0afe408d059b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:27 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 Jul 08 11:14:27 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-8f5d5309-59ab-4fca-beff-cac72b3d5dce req-4d3a6edb-f389-457f-be6e-a163e1680205 tempest-AttachVolumeTestJSON-1835886493 None] Terminate volume connection completed successfully. Jul 08 11:14:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-8f5d5309-59ab-4fca-beff-cac72b3d5dce req-4d3a6edb-f389-457f-be6e-a163e1680205 tempest-AttachVolumeTestJSON-1835886493 None] Deleting attachment 061e4495-ec97-4089-9fd7-eef38fc64b4d. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:14:28 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372" returned: 0 in 0.951s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1254bd5-9c52-40c5-bafa-075e46064763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:14:28 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b29f5-67fb-4abd-b2ac-97bb4da84510]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:28 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 Jul 08 11:14:28 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-5880f7af-c5be-4be5-b0b2-4c6730ed094c tempest-ServerActionsTestOtherA-605180411 None] Terminate volume connection completed successfully. Jul 08 11:14:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-5880f7af-c5be-4be5-b0b2-4c6730ed094c tempest-ServerActionsTestOtherA-605180411 None] Deleting attachment 4c7529a4-cb6c-4f54-8615-29bb2b4e031f. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:14:29 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763" returned: 0 in 1.009s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:29 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 Jul 08 11:14:29 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:30 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:30 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372 Jul 08 11:14:30 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:31 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763.1ef2dd4e-fe71-4b1b-950e-701755823372" returned: 0 in 0.839s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-1ef2dd4e-fe71-4b1b-950e-701755823372" released by "_delete_snapshot" :: held 3.781s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" released by "delete_snapshot" :: held 3.820s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:31 devstack cinder-volume[86852]: WARNING cinder.quota [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1958644955 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1958644955, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:14:31 devstack cinder-volume[86852]: WARNING cinder.quota [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1958644955 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1958644955, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:14:31 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] Created reservations ['02a48b15-5108-4ecc-b48a-f0489b565a5a', '1e5626e3-417d-4162-bf8b-6efc724e9d0b', '60333d33-d5cc-43bf-9e12-f11a55254870', 'f601df5e-347c-4bb6-bcde-043aa24aa2b2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b7629ced-32e4-4350-b39d-2cb59c111d3b tempest-GroupSnapshotsV319Test-1000825905 None] group_snapshot 2cfa6354-324a-439e-9ca2-6b78789b1577: deleted successfully Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c733a-cf1a-48e8-aa8f-e98c4ada9250]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:32 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f Jul 08 11:14:32 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" acquired by "delete_volume" :: waited 0.045s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c254c3-221c-4b5d-ac2c-76b79bd2eaff]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:32 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 Jul 08 11:14:32 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:32 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f" returned: 0 in 0.906s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-9cc22993-fd6a-451a-b417-315d388a9e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfec34b-9191-4d9f-84eb-d43859e7e686', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:14:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-076cdeed-2fe3-450b-8c89-047bb343f56b req-f8c7b8ae-6b67-471a-917e-7008aa376c4f tempest-ServerActionsTestOtherA-605180411 None] attachment_update completed successfully. Jul 08 11:14:33 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763" returned: 0 in 0.893s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:33 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763 Jul 08 11:14:33 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:34 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1254bd5-9c52-40c5-bafa-075e46064763" returned: 0 in 0.691s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "cinder-quobyte-f1254bd5-9c52-40c5-bafa-075e46064763" released by "delete_volume" :: held 1.693s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Created reservations ['173d6b25-a508-434c-8313-9a0d04f7c93a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:34 devstack cinder-volume[86852]: WARNING cinder.quota [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1958644955 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1958644955, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Created reservations ['e1c6bfe8-1434-4fca-a8e1-76b0778831a6', 'bdf8ec1c-3285-4826-81d6-e4cb0a04532d', 'f3b1a54c-b441-41ec-bb7e-76172ae09d6d', 'b189698e-91da-4694-85de-5cb8c6753abf'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:34 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:34 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:35 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.753s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:35 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d4ffd185-4650-4a8f-9ff7-bb16ae3fea73 tempest-GroupSnapshotsV319Test-1000825905 None] Delete group completed successfully. Jul 08 11:14:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=45,cinder:SELECT=54,cinder:DELETE=3,cinder:INSERT=13 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:14:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:14:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-31a5766f-f47b-47af-acc4-ec36c912a3ab tempest-GroupsTest-1581773846 None] Group tempest-Group1-685895330: creating Jul 08 11:14:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-31a5766f-f47b-47af-acc4-ec36c912a3ab tempest-GroupsTest-1581773846 None] Group tempest-Group1-685895330: created successfully Jul 08 11:14:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-31a5766f-f47b-47af-acc4-ec36c912a3ab tempest-GroupsTest-1581773846 None] Create group completed successfully. Jul 08 11:14:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-02e9d806-efa8-471e-8649-6ee60a8e5e44 tempest-GroupsTest-1581773846 None] Group tempest-Group2-1492806515: creating Jul 08 11:14:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-02e9d806-efa8-471e-8649-6ee60a8e5e44 tempest-GroupsTest-1581773846 None] Group tempest-Group2-1492806515: created successfully Jul 08 11:14:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-02e9d806-efa8-471e-8649-6ee60a8e5e44 tempest-GroupsTest-1581773846 None] Create group completed successfully. Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (d4c3a1fc-61a3-43bb-8eda-69e9ac76dca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed52a7-ae1e-4315-afa0-2aaeca177e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed52a7-ae1e-4315-afa0-2aaeca177e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-408360787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df718be3-8045-4adf-8199-9db2775a90a1,host='devstack@QuobyteHD#QuobyteHD',id=33ce3daa-2596-4fbb-93d5-e830f85a21f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:48Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0fb682-0341-4af0-aa28-d4f3c6ef834e),volume_type_id=ca0fb682-0341-4af0-aa28-d4f3c6ef834e)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da612e9e-b3e4-4a0a-9f07-63a2db828ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da612e9e-b3e4-4a0a-9f07-63a2db828ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c5aef-d4d0-42c0-9653-3984b9117432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1c5aef-d4d0-42c0-9653-3984b9117432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ce3daa-2596-4fbb-93d5-e830f85a21f9', 'volume_name': 'volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbf8514-8684-485f-8008-97e88c927ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbf8514-8684-485f-8008-97e88c927ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac86b30e-580f-4c00-bf54-e663472a16f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Volume 33ce3daa-2596-4fbb-93d5-e830f85a21f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9', 'volume_size': 1} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df718be3-8045-4adf-8199-9db2775a90a1,created_at=2026-07-08T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-408360787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df718be3-8045-4adf-8199-9db2775a90a1,host='devstack@QuobyteHD#QuobyteHD',id=33ce3daa-2596-4fbb-93d5-e830f85a21f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:48Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0fb682-0341-4af0-aa28-d4f3c6ef834e),volume_type_id=ca0fb682-0341-4af0-aa28-d4f3c6ef834e)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Creating volume 33ce3daa-2596-4fbb-93d5-e830f85a21f9 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:14:47 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:14:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:48 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 1073741824 Jul 08 11:14:48 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:49 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 1073741824" returned: 0 in 1.338s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:49 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 Jul 08 11:14:49 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:50 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9" returned: 0 in 0.732s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac86b30e-580f-4c00-bf54-e663472a16f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432db7c1-eaa5-4076-8991-e52d8bf8f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Volume volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 (33ce3daa-2596-4fbb-93d5-e830f85a21f9): created successfully Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432db7c1-eaa5-4076-8991-e52d8bf8f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (d4c3a1fc-61a3-43bb-8eda-69e9ac76dca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d400ce07-38b1-4b99-9eb5-edfe8dce1f86 tempest-GroupsTest-1581773846 None] Created volume successfully. Jul 08 11:14:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Acquiring lock "cinder-quobyte-33ce3daa-2596-4fbb-93d5-e830f85a21f9" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:14:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-33ce3daa-2596-4fbb-93d5-e830f85a21f9" acquired by "delete_volume" :: waited 0.047s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:14:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36e3342-ec01-47eb-983e-1548221bc578]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:14:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:51 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 Jul 08 11:14:51 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:52 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:52 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:53 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9" returned: 0 in 1.868s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:53 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9 Jul 08 11:14:53 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:53 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.710s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 8 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:14:54 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-33ce3daa-2596-4fbb-93d5-e830f85a21f9" returned: 0 in 1.190s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-33ce3daa-2596-4fbb-93d5-e830f85a21f9" released by "delete_volume" :: held 3.148s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Created reservations ['8103bc53-895d-4cca-a88b-cbe4b88539c5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:54 devstack cinder-volume[86852]: WARNING cinder.quota [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-713953368 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-713953368, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:14:54 devstack cinder-volume[86852]: WARNING cinder.quota [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-713953368 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-713953368, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Created reservations ['fe5411e3-0a2a-41ea-8815-db2260e7d9fc', 'd20d4b66-b880-4668-9fd8-cbfb0cd3042d', 'c7ee21ed-798e-45b0-987c-3eacd945742b', '727f9e52-dcbb-42e6-b62d-74ccb026dd44'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:55 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:55 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:55 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.898s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:55 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-faeb1851-aee9-47d7-b3be-308261044499 tempest-GroupsTest-1581773846 None] Delete group completed successfully. Jul 08 11:14:55 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Created reservations ['d8335365-3a16-4145-85cc-d1c867b2c6b6'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:56 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:14:56 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:56 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:56 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:14:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c7c3dc3c-b08c-48fa-a1a4-28ffd8bee595 tempest-GroupsTest-1581773846 None] Delete group completed successfully. Jul 08 11:14:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-793cdfcc-e651-4fe9-aa86-ff366b3cf6cb tempest-GroupsTest-1581773846 None] Group tempest-GroupsTest-Group-591580876: creating Jul 08 11:14:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-793cdfcc-e651-4fe9-aa86-ff366b3cf6cb tempest-GroupsTest-1581773846 None] Group tempest-GroupsTest-Group-591580876: created successfully Jul 08 11:14:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-793cdfcc-e651-4fe9-aa86-ff366b3cf6cb tempest-GroupsTest-1581773846 None] Create group completed successfully. Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (b13c3c1e-a1f5-44c2-85f4-5a5ec3b197ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d64aac-856a-4c19-a815-b722a63a9d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d64aac-856a-4c19-a815-b722a63a9d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271058338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,host='devstack@QuobyteHD#QuobyteHD',id=cea8cf01-0dd4-4276-b036-8675f8e4491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:59Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a8e1e7-6c86-4616-a433-56e650c9a483),volume_type_id=97a8e1e7-6c86-4616-a433-56e650c9a483)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc72809-0d5e-4933-9c1d-e63e5f6a8358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc72809-0d5e-4933-9c1d-e63e5f6a8358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ccfa40-88ce-4c88-9faa-7221bfd6caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ccfa40-88ce-4c88-9faa-7221bfd6caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea8cf01-0dd4-4276-b036-8675f8e4491e', 'volume_name': 'volume-cea8cf01-0dd4-4276-b036-8675f8e4491e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2c7ba-8675-46da-8e9e-4343d2c5f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2c7ba-8675-46da-8e9e-4343d2c5f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4ae903-91ad-41be-a5ad-d03f17a3bc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:14:59 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Volume cea8cf01-0dd4-4276-b036-8675f8e4491e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea8cf01-0dd4-4276-b036-8675f8e4491e', 'volume_size': 1} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,created_at=2026-07-08T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271058338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,host='devstack@QuobyteHD#QuobyteHD',id=cea8cf01-0dd4-4276-b036-8675f8e4491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:14:59Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a8e1e7-6c86-4616-a433-56e650c9a483),volume_type_id=97a8e1e7-6c86-4616-a433-56e650c9a483)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Creating volume cea8cf01-0dd4-4276-b036-8675f8e4491e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:14:59 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:14:59 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e 1073741824 Jul 08 11:14:59 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:14:59 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e 1073741824" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:14:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:00 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e Jul 08 11:15:00 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:00 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4ae903-91ad-41be-a5ad-d03f17a3bc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea8cf01-0dd4-4276-b036-8675f8e4491e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cfac5c-ab4c-4937-ba8c-ed8558a6e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Volume volume-cea8cf01-0dd4-4276-b036-8675f8e4491e (cea8cf01-0dd4-4276-b036-8675f8e4491e): created successfully Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cfac5c-ab4c-4937-ba8c-ed8558a6e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (b13c3c1e-a1f5-44c2-85f4-5a5ec3b197ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5c842df9-12a1-4dd2-a52f-1ff6e5b2397f tempest-GroupsTest-1581773846 None] Created volume successfully. Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (033ac5f7-57b4-465b-8fa6-a01c26003ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bea2472-3412-4091-a6a1-4af6ea51c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bea2472-3412-4091-a6a1-4af6ea51c597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1915037713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,host='devstack@QuobyteHD#QuobyteHD',id=e6f8f065-d30c-4a0b-9623-161edce426ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:02Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a8e1e7-6c86-4616-a433-56e650c9a483),volume_type_id=97a8e1e7-6c86-4616-a433-56e650c9a483)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ad19a2-a93a-42fc-802e-b21a09321285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ad19a2-a93a-42fc-802e-b21a09321285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4fb9f-c518-4da8-b4b6-9b0912c74bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed4fb9f-c518-4da8-b4b6-9b0912c74bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f8f065-d30c-4a0b-9623-161edce426ff', 'volume_name': 'volume-e6f8f065-d30c-4a0b-9623-161edce426ff', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac6d04-f316-4db2-a1f2-a8f64a9da328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac6d04-f316-4db2-a1f2-a8f64a9da328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97aa128-18bc-468e-8f24-fbf1f48b7a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Volume e6f8f065-d30c-4a0b-9623-161edce426ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f8f065-d30c-4a0b-9623-161edce426ff', 'volume_size': 1} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,created_at=2026-07-08T09:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1915037713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=051dd8a3-9cbe-4f3c-a41a-519b003224e1,host='devstack@QuobyteHD#QuobyteHD',id=e6f8f065-d30c-4a0b-9623-161edce426ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3b9288cbe643bc99b2ddf99c763f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:02Z,use_quota=True,user_id='041da3570e9e4812af81f68aea085a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a8e1e7-6c86-4616-a433-56e650c9a483),volume_type_id=97a8e1e7-6c86-4616-a433-56e650c9a483)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Creating volume e6f8f065-d30c-4a0b-9623-161edce426ff {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:15:02 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:15:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:02 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff 1073741824 Jul 08 11:15:02 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:03 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff 1073741824" returned: 0 in 0.885s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:03 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff Jul 08 11:15:03 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:03 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff" returned: 0 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97aa128-18bc-468e-8f24-fbf1f48b7a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f8f065-d30c-4a0b-9623-161edce426ff', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb98f777-a4ea-4915-a798-e9e7fb31a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Volume volume-e6f8f065-d30c-4a0b-9623-161edce426ff (e6f8f065-d30c-4a0b-9623-161edce426ff): created successfully Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb98f777-a4ea-4915-a798-e9e7fb31a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Flow 'volume_create_manager' (033ac5f7-57b4-465b-8fa6-a01c26003ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c3374ab1-65d1-4fbf-a412-0f230b7da923 tempest-GroupsTest-1581773846 None] Created volume successfully. Jul 08 11:15:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4f1bf8b6-aca3-4b79-b4c4-b7e375bbc719 tempest-GroupsTest-1581773846 None] Update group completed successfully. Jul 08 11:15:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-46c9210d-ef99-437f-b896-300b51dd8f77 tempest-GroupsTest-1581773846 None] Update group completed successfully. Jul 08 11:15:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Acquiring lock "cinder-quobyte-cea8cf01-0dd4-4276-b036-8675f8e4491e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-cea8cf01-0dd4-4276-b036-8675f8e4491e" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[25358ce1-aa19-43ce-a2c9-a13dbc84dda8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:08 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e Jul 08 11:15:08 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:09 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e" returned: 0 in 0.904s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:09 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e Jul 08 11:15:09 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:09 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cea8cf01-0dd4-4276-b036-8675f8e4491e" returned: 0 in 0.734s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-cea8cf01-0dd4-4276-b036-8675f8e4491e" released by "delete_volume" :: held 1.704s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Acquiring lock "cinder-quobyte-e6f8f065-d30c-4a0b-9623-161edce426ff" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-e6f8f065-d30c-4a0b-9623-161edce426ff" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b83c2-9435-4053-bc27-f0eed5e941ea]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:09 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff Jul 08 11:15:09 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:10 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff" returned: 0 in 0.900s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:10 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff Jul 08 11:15:10 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:15:11 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Flow 'volume_create_manager' (f70a5925-3f8c-4c9e-bc6d-e158dbe8c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558e7a0-a72a-479e-99e0-f130eb2388e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6f8f065-d30c-4a0b-9623-161edce426ff" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4558e7a0-a72a-479e-99e0-f130eb2388e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-83194647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898aefb8-e505-4b7b-9516-407b71ac24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b925cd177ba44c99d3cc803a069d96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:11Z,use_quota=True,user_id='c7e7065fd6c4403d94e75ecbb09911ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7347bd59-2f0b-44be-a2c7-afe0bc1094db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7347bd59-2f0b-44be-a2c7-afe0bc1094db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bb3ad0-3b7a-4cc4-ae1f-db8d45f8a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bb3ad0-3b7a-4cc4-ae1f-db8d45f8a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898aefb8-e505-4b7b-9516-407b71ac24b4', 'volume_name': 'volume-898aefb8-e505-4b7b-9516-407b71ac24b4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c037998-5f51-4e50-ab6d-459c93bf5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c037998-5f51-4e50-ab6d-459c93bf5eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213cf1e2-b289-4dfb-b63d-e14460639090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Volume 898aefb8-e505-4b7b-9516-407b71ac24b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898aefb8-e505-4b7b-9516-407b71ac24b4', 'volume_size': 1} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-83194647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898aefb8-e505-4b7b-9516-407b71ac24b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b925cd177ba44c99d3cc803a069d96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:11Z,use_quota=True,user_id='c7e7065fd6c4403d94e75ecbb09911ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Creating volume 898aefb8-e505-4b7b-9516-407b71ac24b4 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:15:11 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "cinder-quobyte-e6f8f065-d30c-4a0b-9623-161edce426ff" released by "delete_volume" :: held 1.823s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:11 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 1073741824 Jul 08 11:15:11 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Created reservations ['8c7d6652-19e5-4fbd-93fd-154c7b9215b5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:11 devstack cinder-volume[86852]: WARNING cinder.quota [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-59897015 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-59897015, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:15:11 devstack cinder-volume[86852]: WARNING cinder.quota [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-59897015 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-59897015, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Created reservations ['6d860151-e073-4a42-803e-962c7ed79dbb', '4b8645e2-3799-44d7-b5da-f9cc5d66149e', '1278d583-7634-4705-825e-6e6f7ac29660', 'fcf0b009-9a72-4c37-8bfb-0fd1543e9c94'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Created reservations ['c53c78ed-9bd9-4226-b657-c64435426487', '048c3bbd-86b5-4433-bb13-eea557900ea0', 'ad27f150-ea16-4336-afed-f7937889f430', 'ea7028c5-47c7-4ee5-883a-58236909edc7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:12 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:15:12 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:12 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 1073741824" returned: 0 in 0.885s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:12 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 Jul 08 11:15:12 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:12 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.763s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:12 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:15:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fa2425f6-1063-45ba-86d5-906d1aed3254 tempest-GroupsTest-1581773846 None] Delete group completed successfully. Jul 08 11:15:13 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4" returned: 0 in 0.878s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213cf1e2-b289-4dfb-b63d-e14460639090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898aefb8-e505-4b7b-9516-407b71ac24b4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1bed2b-5dd4-4fdb-8b04-6bb6c54dc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:13 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Volume volume-898aefb8-e505-4b7b-9516-407b71ac24b4 (898aefb8-e505-4b7b-9516-407b71ac24b4): created successfully Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1bed2b-5dd4-4fdb-8b04-6bb6c54dc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Flow 'volume_create_manager' (f70a5925-3f8c-4c9e-bc6d-e158dbe8c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9a9e0830-a700-401a-b18e-087b3bb821cc tempest-DeleteServersTestJSON-974009235 None] Created volume successfully. Jul 08 11:15:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c269b-7bf3-4fff-a51a-394975133626]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:17 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 Jul 08 11:15:17 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:18 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4" returned: 0 in 1.010s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-898aefb8-e505-4b7b-9516-407b71ac24b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f19934a7-df25-48ba-b0d3-5a2cd92bd499', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:15:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-d1b449c2-33c8-46ec-a4c1-a7a56958b4c4 req-8300b7a9-a5bb-4ce7-96f2-83bfe7bc2ec2 tempest-DeleteServersTestJSON-974009235 None] attachment_update completed successfully. Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Flow 'volume_create_manager' (8389a0d6-dcf7-4830-ae00-0b9f4e9bd6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301673a-10f8-4ec0-bef0-bcaf1093d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301673a-10f8-4ec0-bef0-bcaf1093d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1257362907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111c17e0-ca2c-4f24-9a97-6d3eba099377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a8290c0a5418bac07234b598c6ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:20Z,use_quota=True,user_id='6452f741b8ff424cb7e55fc737c2a7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc25a96c-b3d7-4b8c-a709-1f410ffb492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc25a96c-b3d7-4b8c-a709-1f410ffb492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5d9fac-0d4e-45c2-a5fe-d3c477be9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5d9fac-0d4e-45c2-a5fe-d3c477be9acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111c17e0-ca2c-4f24-9a97-6d3eba099377', 'volume_name': 'volume-111c17e0-ca2c-4f24-9a97-6d3eba099377', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cf8932-9062-45e8-924a-9bbab21205af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cf8932-9062-45e8-924a-9bbab21205af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aba71a-ae05-43ec-b6dd-a09dd4fa3ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Volume 111c17e0-ca2c-4f24-9a97-6d3eba099377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111c17e0-ca2c-4f24-9a97-6d3eba099377', 'volume_size': 1} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1257362907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111c17e0-ca2c-4f24-9a97-6d3eba099377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a8290c0a5418bac07234b598c6ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:20Z,use_quota=True,user_id='6452f741b8ff424cb7e55fc737c2a7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Creating volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:15:19 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:15:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:19 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 1073741824 Jul 08 11:15:19 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:20 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 1073741824" returned: 0 in 0.983s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:20 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 Jul 08 11:15:20 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:21 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377" returned: 0 in 0.728s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aba71a-ae05-43ec-b6dd-a09dd4fa3ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111c17e0-ca2c-4f24-9a97-6d3eba099377', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab821e4-2265-4493-a61b-e0fc81141aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Volume volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 (111c17e0-ca2c-4f24-9a97-6d3eba099377): created successfully Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab821e4-2265-4493-a61b-e0fc81141aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Flow 'volume_create_manager' (8389a0d6-dcf7-4830-ae00-0b9f4e9bd6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2e6a6529-5890-4b7e-8dd8-2be878c001c4 tempest-SnapshotsActionsTest-1432667262 None] Created volume successfully. Jul 08 11:15:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-704cd12e-3cd9-42a6-9e65-700deff0b9ab req-447bd03b-65d6-46f9-a83a-c2eb0bddf0a1 tempest-ServerActionsTestOtherA-605180411 None] Terminate volume connection completed successfully. Jul 08 11:15:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-704cd12e-3cd9-42a6-9e65-700deff0b9ab req-447bd03b-65d6-46f9-a83a-c2eb0bddf0a1 tempest-ServerActionsTestOtherA-605180411 None] Deleting attachment 6bfec34b-9191-4d9f-84eb-d43859e7e686. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:15:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Creating offline snapshot ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:15:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd934442-d5ee-4d87-bd7e-6087da90b0f3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:23 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 Jul 08 11:15:23 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:24 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377" returned: 0 in 0.915s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:24 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 1G Jul 08 11:15:24 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:25 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 1G" returned: 0 in 1.072s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:25 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:25 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:26 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.935s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:26 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 is being set with open permissions: ugo+rw Jul 08 11:15:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:26 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:26 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:26 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:26 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info Jul 08 11:15:26 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-06215e97-c9bd-4d21-a49a-011be498632a req-85ad28ec-1c9c-433d-ac63-2269deee723b tempest-DeleteServersTestJSON-974009235 None] Terminate volume connection completed successfully. Jul 08 11:15:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-06215e97-c9bd-4d21-a49a-011be498632a req-85ad28ec-1c9c-433d-ac63-2269deee723b tempest-DeleteServersTestJSON-974009235 None] Deleting attachment f19934a7-df25-48ba-b0d3-5a2cd92bd499. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:15:27 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:27 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info is being set with open permissions: ugo+rw Jul 08 11:15:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:27 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info Jul 08 11:15:27 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:28 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.info" returned: 0 in 0.740s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.358s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d8aeddf0-033b-443f-9327-83df7a07d963 tempest-SnapshotsActionsTest-1432667262 None] Create snapshot completed successfully Jul 08 11:15:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Creating offline snapshot efd45aaf-bd36-4d72-b65f-17457fd8f303 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:15:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5b4fd-27f0-4397-9b07-8aebb630866d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:30 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:30 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:30 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:30 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 1G Jul 08 11:15:30 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "cinder-898aefb8-e505-4b7b-9516-407b71ac24b4-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "cinder-898aefb8-e505-4b7b-9516-407b71ac24b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "cinder-quobyte-898aefb8-e505-4b7b-9516-407b71ac24b4" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "cinder-quobyte-898aefb8-e505-4b7b-9516-407b71ac24b4" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c9292-7276-427a-b9a1-32355d3d4472]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:31 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 Jul 08 11:15:31 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:31 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 1G" returned: 0 in 1.191s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:31 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 Jul 08 11:15:31 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:32 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4" returned: 0 in 0.927s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:32 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4 Jul 08 11:15:32 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:32 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:32 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 is being set with open permissions: ugo+rw Jul 08 11:15:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:32 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 Jul 08 11:15:32 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:33 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-898aefb8-e505-4b7b-9516-407b71ac24b4" returned: 0 in 0.974s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "cinder-quobyte-898aefb8-e505-4b7b-9516-407b71ac24b4" released by "delete_volume" :: held 1.975s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Created reservations ['4df80d24-6ccd-4246-9d95-169d5150a686', 'f0a39748-6ab9-4e20-a328-b487f420460e', '07f3d28b-7cef-409c-93e0-624284426aae', '9d53a5b2-5055-40a9-900f-d766dc67cb7c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:33 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:15:33 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:33 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303" returned: 0 in 1.173s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.164s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6a69b9b6-cd68-4fad-8bee-854b567599fd tempest-SnapshotsActionsTest-1432667262 None] Create snapshot completed successfully Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "cinder-9cc22993-fd6a-451a-b417-315d388a9e3f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "cinder-9cc22993-fd6a-451a-b417-315d388a9e3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "cinder-quobyte-9cc22993-fd6a-451a-b417-315d388a9e3f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "cinder-quobyte-9cc22993-fd6a-451a-b417-315d388a9e3f" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f7dce9-fb76-4ef1-a27d-d5365f4c1fdd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:34 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f Jul 08 11:15:34 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:34 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.905s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:15:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Deleted volume successfully. Jul 08 11:15:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6c1bc3af-e722-4da7-9031-bf7ef95d4806 tempest-DeleteServersTestJSON-974009235 None] Lock "cinder-898aefb8-e505-4b7b-9516-407b71ac24b4-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-efd45aaf-bd36-4d72-b65f-17457fd8f303-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-efd45aaf-bd36-4d72-b65f-17457fd8f303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-efd45aaf-bd36-4d72-b65f-17457fd8f303" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-efd45aaf-bd36-4d72-b65f-17457fd8f303" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Deleting offline snapshot efd45aaf-bd36-4d72-b65f-17457fd8f303 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] snapshot_file for this snap is: volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2865ac-60aa-4d63-8dbe-620a5240410c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:35 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f" returned: 0 in 1.092s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:35 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f Jul 08 11:15:35 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:35 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 Jul 08 11:15:35 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:36 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303" returned: 0 in 0.924s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05a3d44-2399-4cae-93ff-5e6d97e5c9ca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:36 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc22993-fd6a-451a-b417-315d388a9e3f" returned: 0 in 1.102s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "cinder-quobyte-9cc22993-fd6a-451a-b417-315d388a9e3f" released by "delete_volume" :: held 2.245s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:36 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:36 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Created reservations ['e6e40255-055d-4411-8eb6-77d8f49989d8', '52f688d6-e59e-4587-b586-2cba1ba59f1c', '17d0ed57-dc3b-482d-b714-2c1cd555808b', '4e1c3276-9336-4041-a05c-c6fc9fe9865f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:36 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:15:36 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:37 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:15:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Deleted volume successfully. Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bb0af68-9a85-4b95-9d38-c7a7aa790d4b tempest-ServerActionsTestOtherA-605180411 None] Lock "cinder-9cc22993-fd6a-451a-b417-315d388a9e3f-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:37 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.179s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:37 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 Jul 08 11:15:37 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:38 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303" returned: 0 in 1.171s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:38 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303 Jul 08 11:15:38 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:40 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.efd45aaf-bd36-4d72-b65f-17457fd8f303" returned: 0 in 1.142s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-efd45aaf-bd36-4d72-b65f-17457fd8f303" released by "_delete_snapshot" :: held 4.580s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_snapshot" :: held 4.638s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:40 devstack cinder-volume[86852]: WARNING cinder.quota [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:15:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Created reservations ['875dad53-0f47-4bf9-b1dd-29fc730496d0', '910a51a4-292a-47b0-84d4-86bcd7be2971', 'b2b0e182-ad32-4cd4-aa52-3115b3206963', '230aaa44-6101-40db-832b-ff0312f2a528'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Delete snapshot completed successfully. Jul 08 11:15:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-08c87288-0d57-4168-8ae6-2a7b670fbe29 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-efd45aaf-bd36-4d72-b65f-17457fd8f303-delete_snapshot" released by "delete_snapshot" :: held 4.925s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Creating offline snapshot 7067b23a-88db-4e0b-a74b-74e51e1810eb of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:15:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c477506d-5e1d-4333-bb24-b54f615f398e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:41 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:41 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:42 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.020s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:42 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb 1G Jul 08 11:15:42 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:43 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb 1G" returned: 0 in 1.056s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:43 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb Jul 08 11:15:43 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:44 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:44 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb is being set with open permissions: ugo+rw Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:44 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb Jul 08 11:15:44 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:44 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb" returned: 0 in 0.678s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=75,cinder:SELECT=68,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=82,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:15:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.669s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0d6c37c2-787c-409a-9bd3-165366444fa3 tempest-SnapshotsActionsTest-1432667262 None] Create snapshot completed successfully Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-7067b23a-88db-4e0b-a74b-74e51e1810eb-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-7067b23a-88db-4e0b-a74b-74e51e1810eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-7067b23a-88db-4e0b-a74b-74e51e1810eb" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-7067b23a-88db-4e0b-a74b-74e51e1810eb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Deleting offline snapshot 7067b23a-88db-4e0b-a74b-74e51e1810eb of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] snapshot_file for this snap is: volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983e689-b177-4983-a15d-da1843235feb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:45 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb Jul 08 11:15:45 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:46 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb" returned: 0 in 0.816s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e60231-ae9c-41d7-aa0d-f3fce9abdaa4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:46 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:46 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:47 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.830s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:47 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb Jul 08 11:15:47 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:48 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb" returned: 0 in 0.916s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:48 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb Jul 08 11:15:48 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:48 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.7067b23a-88db-4e0b-a74b-74e51e1810eb" returned: 0 in 0.662s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-7067b23a-88db-4e0b-a74b-74e51e1810eb" released by "_delete_snapshot" :: held 3.331s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_snapshot" :: held 3.353s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:49 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Created reservations ['146d257a-c1a6-4fb4-83cf-20b652f3b7ec', 'eda82abe-bd9a-452a-95c4-579c884e560d', 'e9076f6b-c6a4-4a2e-a44b-1069b9441b9c', 'a2bbc9a0-878c-425e-84e7-81fe48feea4e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Delete snapshot completed successfully. Jul 08 11:15:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-351d2e90-02bf-4a07-90cd-fa8fe439d5b2 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-7067b23a-88db-4e0b-a74b-74e51e1810eb-delete_snapshot" released by "delete_snapshot" :: held 3.562s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Creating offline snapshot f9f9f710-6e00-4718-b165-4739ed3d8ea2 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:15:50 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa057d5-de1f-457f-9b87-8888511e7007]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:50 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:50 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:51 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.945s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:51 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 1G Jul 08 11:15:51 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:52 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:15:52 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:52 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 1G" returned: 0 in 1.270s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:52 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 Jul 08 11:15:52 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:53 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.981s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 8 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:15:53 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2" returned: 0 in 1.306s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:53 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 is being set with open permissions: ugo+rw Jul 08 11:15:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:53 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 Jul 08 11:15:53 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:54 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2" returned: 0 in 0.844s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f9cf0f7d-da64-487c-bd83-b98c0619e6f4 tempest-SnapshotsActionsTest-1432667262 None] Create snapshot completed successfully Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (aac15ca1-2790-4197-80b6-1001408cc064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f0c121-b9ad-412f-822d-6a3046788623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f0c121-b9ad-412f-822d-6a3046788623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-72165957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc545b3-830a-4d16-ab37-69e43e7023fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:55Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7b06b5-afc3-4181-8560-80ce92c15613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7b06b5-afc3-4181-8560-80ce92c15613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1003997a-5e3b-42c1-abd1-9841855890e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1003997a-5e3b-42c1-abd1-9841855890e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc545b3-830a-4d16-ab37-69e43e7023fe', 'volume_name': 'volume-9cc545b3-830a-4d16-ab37-69e43e7023fe', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985bd2f-0e93-404b-a382-62f9de328c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4985bd2f-0e93-404b-a382-62f9de328c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f856cf-7a29-430c-a131-71a333ebbae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:55 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Volume 9cc545b3-830a-4d16-ab37-69e43e7023fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc545b3-830a-4d16-ab37-69e43e7023fe', 'volume_size': 1} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-72165957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc545b3-830a-4d16-ab37-69e43e7023fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:15:55Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Creating volume 9cc545b3-830a-4d16-ab37-69e43e7023fe {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:15:55 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:55 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe 1073741824 Jul 08 11:15:55 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-f9f9f710-6e00-4718-b165-4739ed3d8ea2-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-f9f9f710-6e00-4718-b165-4739ed3d8ea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-f9f9f710-6e00-4718-b165-4739ed3d8ea2" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-f9f9f710-6e00-4718-b165-4739ed3d8ea2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Deleting offline snapshot f9f9f710-6e00-4718-b165-4739ed3d8ea2 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] snapshot_file for this snap is: volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[172bd4f4-4baa-40d9-b07c-6ee5cdc59182]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:55 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 Jul 08 11:15:55 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:56 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe 1073741824" returned: 0 in 0.973s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:56 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe Jul 08 11:15:56 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:56 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2" returned: 0 in 1.016s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d07cb7-a766-48dd-90e8-f929ac755a51]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:15:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:56 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:15:56 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:57 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe" returned: 0 in 0.858s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f856cf-7a29-430c-a131-71a333ebbae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc545b3-830a-4d16-ab37-69e43e7023fe', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e51ab62-6afb-4152-b739-d28bf4f7f53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:15:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Volume volume-9cc545b3-830a-4d16-ab37-69e43e7023fe (9cc545b3-830a-4d16-ab37-69e43e7023fe): created successfully Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e51ab62-6afb-4152-b739-d28bf4f7f53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (aac15ca1-2790-4197-80b6-1001408cc064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:15:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-beeacbac-68c8-490f-b150-c8150a423eac tempest-AttachVolumeTestJSON-1835886493 None] Created volume successfully. Jul 08 11:15:57 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.049s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:15:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:57 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 Jul 08 11:15:57 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:58 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2" returned: 0 in 1.085s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:15:59 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2 Jul 08 11:15:59 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:15:59 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Jul 08 11:15:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.f9f9f710-6e00-4718-b165-4739ed3d8ea2" returned: 0 in 0.684s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:15:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-f9f9f710-6e00-4718-b165-4739ed3d8ea2" released by "_delete_snapshot" :: held 3.949s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_snapshot" :: held 3.987s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:15:59 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Created reservations ['b6564d89-b8ac-40a8-b722-dc2d92ac3711', 'e35701b7-d338-461d-861d-cd16471d0b1f', '57858c47-2cac-4d44-a560-7c79dc231f74', '36d39393-9bd6-4cb8-ab1f-1213c01fad61'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:15:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Delete snapshot completed successfully. Jul 08 11:15:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ffd98fc-0267-458d-a1fb-b2920d98705b tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-f9f9f710-6e00-4718-b165-4739ed3d8ea2-delete_snapshot" released by "delete_snapshot" :: held 4.214s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Creating offline snapshot a81feb49-8fe8-4655-8f77-d81595f507c9 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:16:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c73352d-bb9f-4a54-95b6-67462be61583]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:00 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:16:00 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:01 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.858s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:16:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:01 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 1G Jul 08 11:16:01 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:02 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 1G" returned: 0 in 1.000s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:02 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 Jul 08 11:16:02 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:03 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9" returned: 0 in 0.906s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:03 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 is being set with open permissions: ugo+rw Jul 08 11:16:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:03 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 Jul 08 11:16:03 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:04 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9" returned: 0 in 0.838s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.765s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.174s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[693902c7-11ca-4a4e-9c62-15b63a90cc68]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dd2dd876-bc50-4e21-86b2-42a4f041147c tempest-SnapshotsActionsTest-1432667262 None] Create snapshot completed successfully Jul 08 11:16:04 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe Jul 08 11:16:04 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-a81feb49-8fe8-4655-8f77-d81595f507c9-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-a81feb49-8fe8-4655-8f77-d81595f507c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Acquiring lock "cinder-quobyte-a81feb49-8fe8-4655-8f77-d81595f507c9" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-a81feb49-8fe8-4655-8f77-d81595f507c9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Deleting offline snapshot a81feb49-8fe8-4655-8f77-d81595f507c9 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] snapshot_file for this snap is: volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e1e700-ff48-4fb6-952a-dab337bd38a9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:05 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe" returned: 0 in 1.007s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.052s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-9cc545b3-830a-4d16-ab37-69e43e7023fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31a312a7-5513-493d-b3c4-bdfb8cff0769', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:16:05 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 Jul 08 11:16:05 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-74530dc9-c5a7-47d8-a703-ddb90691a4f1 req-348e0941-19dc-4e79-9a81-f9aa65ce7a01 tempest-AttachVolumeTestJSON-1835886493 None] attachment_update completed successfully. Jul 08 11:16:06 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9" returned: 0 in 1.008s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[688254cb-66b0-4ecb-b43a-278088abfa7e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:06 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:16:06 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Flow 'volume_create_manager' (1f6b46fb-ef99-4538-840d-8ca939b085d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d15c55-9925-48c0-a283-d3f761553897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d15c55-9925-48c0-a283-d3f761553897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-824688845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de2f39f0848492a9697f71372281ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:06Z,use_quota=True,user_id='9842a4a57a784ed3b9847911e7a74f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed36209-9554-4a8d-a712-90fbd433b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed36209-9554-4a8d-a712-90fbd433b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70021eca-877b-46e8-8dda-c45ffaf3adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70021eca-877b-46e8-8dda-c45ffaf3adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c', 'volume_name': 'volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e963bb34-068d-4bd7-ba2e-bdeb131047ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e963bb34-068d-4bd7-ba2e-bdeb131047ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa4ee6-1fa9-4ee0-91f9-179e00e6499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Volume 11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c', 'volume_size': 1} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-824688845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de2f39f0848492a9697f71372281ea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:06Z,use_quota=True,user_id='9842a4a57a784ed3b9847911e7a74f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Creating volume 11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:16:06 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:16:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:06 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c 1073741824 Jul 08 11:16:06 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:07 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.141s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:16:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:07 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 Jul 08 11:16:07 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:07 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c 1073741824" returned: 0 in 0.999s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:07 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c Jul 08 11:16:07 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:08 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9" returned: 0 in 0.924s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:08 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9 Jul 08 11:16:08 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:08 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" returned: 0 in 0.722s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa4ee6-1fa9-4ee0-91f9-179e00e6499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1e514c-c85c-4cc1-a5dd-c222c19c4a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Volume volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c (11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c): created successfully Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1e514c-c85c-4cc1-a5dd-c222c19c4a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Flow 'volume_create_manager' (1f6b46fb-ef99-4538-840d-8ca939b085d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-45b4cbd8-5fcf-4e7e-9712-17650f37aeb6 tempest-TaggedAttachmentsTest-1712347181 None] Created volume successfully. Jul 08 11:16:08 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.a81feb49-8fe8-4655-8f77-d81595f507c9" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-a81feb49-8fe8-4655-8f77-d81595f507c9" released by "_delete_snapshot" :: held 3.846s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_snapshot" :: held 3.873s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:08 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Created reservations ['81ff9ccc-b880-4e23-8058-5cd17bee76a7', 'e177b4d6-703f-44c0-b7cd-f82b88ec177a', '5060cb4b-94c0-485d-86cc-6fc56457de55', '5755587c-8bc5-4a42-ab12-202590483488'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Delete snapshot completed successfully. Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1dd03c7-13a4-4982-913b-c300ce3a6883 tempest-SnapshotsActionsTest-466289966 None] Lock "cinder-a81feb49-8fe8-4655-8f77-d81595f507c9-delete_snapshot" released by "delete_snapshot" :: held 4.008s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "cinder-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "cinder-quobyte-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Deleting offline snapshot ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 of volume 111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] snapshot_file for this snap is: volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c77634c-142f-492c-9696-766b0cc3478f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:09 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:16:09 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:10 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.045s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111c17e0-ca2c-4f24-9a97-6d3eba099377(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:16:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241bac1-4d8d-44e5-9458-eca673e27a88]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:11 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 Jul 08 11:16:11 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (1469ca99-dd53-461d-a196-0a7ada7507d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571e5805-be71-46d0-af75-418c4e4f476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571e5805-be71-46d0-af75-418c4e4f476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-948282871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c837068-5d6c-4aa6-b062-d8b53c881bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:11Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7399b222-2395-4968-98a7-9e7c4c00fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7399b222-2395-4968-98a7-9e7c4c00fd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8296b8-7901-4433-9a22-cba4d2ec3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8296b8-7901-4433-9a22-cba4d2ec3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c837068-5d6c-4aa6-b062-d8b53c881bca', 'volume_name': 'volume-6c837068-5d6c-4aa6-b062-d8b53c881bca', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a650294-0df5-4f8e-b043-d23e157865da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a650294-0df5-4f8e-b043-d23e157865da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baec83a4-b138-4a8c-b7b4-113d40f4717e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Volume 6c837068-5d6c-4aa6-b062-d8b53c881bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c837068-5d6c-4aa6-b062-d8b53c881bca', 'volume_size': 1} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-948282871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c837068-5d6c-4aa6-b062-d8b53c881bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd0064a928745ae9932ce421aa941c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:11Z,use_quota=True,user_id='d6ec71d423e945fca5c3037a366e3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Creating volume 6c837068-5d6c-4aa6-b062-d8b53c881bca {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:16:11 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:11 devstack sudo[92030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca 1073741824 Jul 08 11:16:11 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:11 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377" returned: 0 in 1.054s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:12 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:16:12 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:12 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca 1073741824" returned: 0 in 1.214s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:12 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca Jul 08 11:16:12 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:13 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 1.092s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:13 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7 Jul 08 11:16:13 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:13 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca" returned: 0 in 0.989s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baec83a4-b138-4a8c-b7b4-113d40f4717e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c837068-5d6c-4aa6-b062-d8b53c881bca', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf97f3-68f6-43fb-b345-87576c465d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:13 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Volume volume-6c837068-5d6c-4aa6-b062-d8b53c881bca (6c837068-5d6c-4aa6-b062-d8b53c881bca): created successfully Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf97f3-68f6-43fb-b345-87576c465d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Flow 'volume_create_manager' (1469ca99-dd53-461d-a196-0a7ada7507d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ae16c093-8898-46c6-a6bb-ae275f056786 tempest-AttachVolumeTestJSON-1835886493 None] Created volume successfully. Jul 08 11:16:13 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377.ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" returned: 0 in 0.870s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7" released by "_delete_snapshot" :: held 4.212s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_snapshot" :: held 4.250s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Created reservations ['59ee46be-54e9-48d3-89ce-968104d7fb2b', '9b0df406-8913-4c83-8b20-92fcb2e97256', '46744a5f-28e9-4ea2-a5e0-432afc4bcf3a', 'f63576e5-5b62-4c50-af92-ffb085582a09'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Delete snapshot completed successfully. Jul 08 11:16:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f17edb4b-916e-4ae8-b0f2-cce8df6f260d tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-ec07bdf1-a0a3-4e22-9cfc-8ed41da50fe7-delete_snapshot" released by "delete_snapshot" :: held 4.435s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "cinder-111c17e0-ca2c-4f24-9a97-6d3eba099377-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-111c17e0-ca2c-4f24-9a97-6d3eba099377-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da22dd1-70eb-48ab-9d40-79331366c865]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:15 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 Jul 08 11:16:15 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:16 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377" returned: 0 in 0.843s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:16 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377 Jul 08 11:16:16 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:16 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-111c17e0-ca2c-4f24-9a97-6d3eba099377" returned: 0 in 0.669s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-quobyte-111c17e0-ca2c-4f24-9a97-6d3eba099377" released by "delete_volume" :: held 1.588s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Created reservations ['be9343e9-8758-48bb-8252-ecfb5995a1f7', 'eeed1bdf-44c1-4922-8c5a-d9a84c5bf391', '2ff7532e-347e-4508-a351-92d8d8491b8c', 'f3bacc53-7b9c-49cb-853b-50fb6f28cdd4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:16 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:16 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c60156-2984-4b76-8877-49d993818af7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:17 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.750s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:17 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Deleted volume successfully. Jul 08 11:16:17 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca Jul 08 11:16:17 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-af1986c2-a778-4a84-93ef-bd1b2e7bf790 tempest-SnapshotsActionsTest-1432667262 None] Lock "cinder-111c17e0-ca2c-4f24-9a97-6d3eba099377-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:18 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca" returned: 0 in 0.833s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-6c837068-5d6c-4aa6-b062-d8b53c881bca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f52a9448-e9d9-4d63-99aa-0603245738e2', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:16:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-95ee5aa2-1002-4d96-af2f-816ab2853422 req-0276a336-9300-4da6-b08c-0dcc10308f34 tempest-AttachVolumeTestJSON-1835886493 None] attachment_update completed successfully. Jul 08 11:16:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-07ec56bb-29e6-4483-95b9-759709b2e5a0 req-9cc0f709-a554-47fc-8271-c33d329e81a2 tempest-AttachVolumeTestJSON-1835886493 None] Terminate volume connection completed successfully. Jul 08 11:16:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-07ec56bb-29e6-4483-95b9-759709b2e5a0 req-9cc0f709-a554-47fc-8271-c33d329e81a2 tempest-AttachVolumeTestJSON-1835886493 None] Deleting attachment 31a312a7-5513-493d-b3c4-bdfb8cff0769. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:16:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-7214aad8-e774-4ca6-8930-7c4f92aa7b32 req-b322c66b-3364-4057-b3bf-940c343e84cd tempest-AttachVolumeTestJSON-1835886493 None] Terminate volume connection completed successfully. Jul 08 11:16:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-7214aad8-e774-4ca6-8930-7c4f92aa7b32 req-b322c66b-3364-4057-b3bf-940c343e84cd tempest-AttachVolumeTestJSON-1835886493 None] Deleting attachment f52a9448-e9d9-4d63-99aa-0603245738e2. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Flow 'volume_create_manager' (c4f75fe1-dca4-46ee-8c09-ff14af10409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f444e1-2c50-478a-be5c-136271ca1b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f444e1-2c50-478a-be5c-136271ca1b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1252236628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452c4ab-34ec-494e-a643-a7e234dd588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8481bc6c24d259a6062621246cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:31Z,use_quota=True,user_id='2d02c465d4594b589a83ab4f871de373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47ef83c-79c9-49df-b56b-ff35ba9f72a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47ef83c-79c9-49df-b56b-ff35ba9f72a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cadfa54-b7b8-47b2-b034-d7925acb287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cadfa54-b7b8-47b2-b034-d7925acb287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd452c4ab-34ec-494e-a643-a7e234dd588f', 'volume_name': 'volume-d452c4ab-34ec-494e-a643-a7e234dd588f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c8de3-14c5-4f4a-a255-e77cc45c1e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c8de3-14c5-4f4a-a255-e77cc45c1e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39a5409-1fae-4bd8-98e9-d1ceab0daf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Volume d452c4ab-34ec-494e-a643-a7e234dd588f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d452c4ab-34ec-494e-a643-a7e234dd588f', 'volume_size': 1} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1252236628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452c4ab-34ec-494e-a643-a7e234dd588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b8481bc6c24d259a6062621246cc27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:31Z,use_quota=True,user_id='2d02c465d4594b589a83ab4f871de373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Creating volume d452c4ab-34ec-494e-a643-a7e234dd588f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:16:31 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:16:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:31 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f 1073741824 Jul 08 11:16:31 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:32 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f 1073741824" returned: 0 in 1.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:33 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f Jul 08 11:16:33 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:34 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f" returned: 0 in 1.751s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] <== create_volume: return (3546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.551s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39a5409-1fae-4bd8-98e9-d1ceab0daf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d452c4ab-34ec-494e-a643-a7e234dd588f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659fd878-6317-464e-b867-8c8b40757dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Volume volume-d452c4ab-34ec-494e-a643-a7e234dd588f (d452c4ab-34ec-494e-a643-a7e234dd588f): created successfully Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659fd878-6317-464e-b867-8c8b40757dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Flow 'volume_create_manager' (c4f75fe1-dca4-46ee-8c09-ff14af10409e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c81429fd-2040-4a99-a9f8-74ff6cd14b0d tempest-VolumesServicesTestJSON-232871748 None] Created volume successfully. Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Acquiring lock "cinder-d452c4ab-34ec-494e-a643-a7e234dd588f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "cinder-d452c4ab-34ec-494e-a643-a7e234dd588f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Acquiring lock "cinder-quobyte-d452c4ab-34ec-494e-a643-a7e234dd588f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "cinder-quobyte-d452c4ab-34ec-494e-a643-a7e234dd588f" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[83181a73-9635-46cf-8b38-a7307cc97ba4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:36 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f Jul 08 11:16:36 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:37 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f" returned: 0 in 1.241s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:37 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f Jul 08 11:16:37 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:38 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d452c4ab-34ec-494e-a643-a7e234dd588f" returned: 0 in 0.847s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "cinder-quobyte-d452c4ab-34ec-494e-a643-a7e234dd588f" released by "delete_volume" :: held 2.130s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Created reservations ['548a210e-dc7c-4906-b628-b098e77a73e6', '7ae2b7b2-c864-47c0-8896-41e0e86413eb', 'dea74ef8-86ba-45c1-928a-6d6925fa1207', '7ed0ea21-f38d-42e9-bb43-e3199db6fecc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:38 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:38 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:38 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.686s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Deleted volume successfully. Jul 08 11:16:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f740453-c04d-452e-960c-4fd6a7763cfe tempest-VolumesServicesTestJSON-232871748 None] Lock "cinder-d452c4ab-34ec-494e-a643-a7e234dd588f-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-6c837068-5d6c-4aa6-b062-d8b53c881bca-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-6c837068-5d6c-4aa6-b062-d8b53c881bca-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-quobyte-6c837068-5d6c-4aa6-b062-d8b53c881bca" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-6c837068-5d6c-4aa6-b062-d8b53c881bca" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c174a-1e46-4aec-accd-7d7d8eddbe98]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:40 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca Jul 08 11:16:40 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:41 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca" returned: 0 in 1.239s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:41 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca Jul 08 11:16:41 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:42 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6c837068-5d6c-4aa6-b062-d8b53c881bca" returned: 0 in 1.251s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-6c837068-5d6c-4aa6-b062-d8b53c881bca" released by "delete_volume" :: held 2.567s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:42 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Created reservations ['dd2a7aa4-3d66-4af7-a5e3-62afda8594a5', '00bfbe99-37c7-4e94-ac4b-3a42a417232d', '569bfe18-d66d-4929-b425-865394acab1b', '7d99e9e1-ccd8-466d-9e1e-fa05ada90cfd'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:43 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:43 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-9cc545b3-830a-4d16-ab37-69e43e7023fe-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-9cc545b3-830a-4d16-ab37-69e43e7023fe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-quobyte-9cc545b3-830a-4d16-ab37-69e43e7023fe" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-9cc545b3-830a-4d16-ab37-69e43e7023fe" acquired by "delete_volume" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03114c3-a0de-4bc3-8bd8-fe6c4e790cce]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:44 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe Jul 08 11:16:44 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:44 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.336s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:44 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Deleted volume successfully. Jul 08 11:16:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ce865013-dd30-4f83-93f5-0a379b99900d tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-6c837068-5d6c-4aa6-b062-d8b53c881bca-delete_volume" released by "delete_volume" :: held 4.389s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:45 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe" returned: 0 in 1.384s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:45 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe Jul 08 11:16:45 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:46 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9cc545b3-830a-4d16-ab37-69e43e7023fe" returned: 0 in 0.953s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-9cc545b3-830a-4d16-ab37-69e43e7023fe" released by "delete_volume" :: held 2.432s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=61,cinder:UPDATE=63,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=65,cinder:INSERT=17,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Created reservations ['1cfc8f4e-b992-4f3f-964c-ee12abb950c9', 'dc6ebbd1-4f3f-4376-a63e-f9c2a0e739f5', '085dd6a7-8f4c-4a22-a6e4-517662866115', 'f0edaee8-5e21-445d-8f54-a078720f8b5f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:46 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:46 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:47 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.672s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Deleted volume successfully. Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76040639-9d6b-4c27-b21f-ae0a31cc11e9 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-9cc545b3-830a-4d16-ab37-69e43e7023fe-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-726409f0-f9bb-490d-b7c0-a0bcc239f930-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-726409f0-f9bb-490d-b7c0-a0bcc239f930-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "cinder-quobyte-726409f0-f9bb-490d-b7c0-a0bcc239f930" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-726409f0-f9bb-490d-b7c0-a0bcc239f930" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cdc83f-8623-41d6-bcdd-6d1bb172bf74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:16:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:47 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 Jul 08 11:16:47 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:48 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930" returned: 0 in 0.872s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:48 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930 Jul 08 11:16:48 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:49 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-726409f0-f9bb-490d-b7c0-a0bcc239f930" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-quobyte-726409f0-f9bb-490d-b7c0-a0bcc239f930" released by "delete_volume" :: held 1.597s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Created reservations ['9972ae52-1141-49d3-9705-19c3b977b500', 'e8eee7b2-633f-446a-89b2-ec5e7a62648c', '7637fe7b-675c-4b67-b6da-e45cb1cc94db', 'aad88050-adc0-45f2-8a8b-97c6f7c993a2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:49 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:49 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:50 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.909s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:50 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Deleted volume successfully. Jul 08 11:16:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c78e8053-54a1-4f10-b2dd-f7d838e57a57 tempest-AttachVolumeTestJSON-1835886493 None] Lock "cinder-726409f0-f9bb-490d-b7c0-a0bcc239f930-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:52 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:16:52 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:53 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.365s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:16:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:16:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 8 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:16:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Flow 'volume_create_manager' (8df7dbe0-3236-4fdf-83b2-4d4f147ed5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497cbad5-5679-4fdf-ae92-8f14c1b9e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497cbad5-5679-4fdf-ae92-8f14c1b9e720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-195388029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab95f954-47d4-485a-9caf-19ae2445fb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695ea5b971f54f6fb1d1258e2f73bc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:56Z,use_quota=True,user_id='34b29b000fea4f2bbccc1f962cd2ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7df168-f46b-4cf1-9039-a28537a7ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7df168-f46b-4cf1-9039-a28537a7ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d028b7-217b-4713-b67d-5a8d9123f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d028b7-217b-4713-b67d-5a8d9123f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab95f954-47d4-485a-9caf-19ae2445fb1c', 'volume_name': 'volume-ab95f954-47d4-485a-9caf-19ae2445fb1c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb65a22a-ca0c-40ec-802b-a81b76cb3fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb65a22a-ca0c-40ec-802b-a81b76cb3fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3d7a06-5715-4e86-8af9-b9ac459f29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Volume ab95f954-47d4-485a-9caf-19ae2445fb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab95f954-47d4-485a-9caf-19ae2445fb1c', 'volume_size': 1} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-195388029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab95f954-47d4-485a-9caf-19ae2445fb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695ea5b971f54f6fb1d1258e2f73bc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:16:56Z,use_quota=True,user_id='34b29b000fea4f2bbccc1f962cd2ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Creating volume ab95f954-47d4-485a-9caf-19ae2445fb1c {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:16:56 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:16:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:56 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c 1073741824 Jul 08 11:16:56 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:57 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c 1073741824" returned: 0 in 1.075s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:16:57 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c Jul 08 11:16:57 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:16:58 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c" returned: 0 in 0.942s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3d7a06-5715-4e86-8af9-b9ac459f29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab95f954-47d4-485a-9caf-19ae2445fb1c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c331fce-429a-4bd5-bdb6-b4f2bd83004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:16:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Volume volume-ab95f954-47d4-485a-9caf-19ae2445fb1c (ab95f954-47d4-485a-9caf-19ae2445fb1c): created successfully Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c331fce-429a-4bd5-bdb6-b4f2bd83004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:16:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Flow 'volume_create_manager' (8df7dbe0-3236-4fdf-83b2-4d4f147ed5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:16:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bf6ff2a7-49e9-4983-a759-537d9d297932 tempest-VolumesTransfersV355Test-104958176 None] Created volume successfully. Jul 08 11:17:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-805fb434-6f24-45c6-8f64-17a2d42234ef tempest-VolumesTransfersV355Test-1968055550 None] Transfer volume completed successfully. Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (6eb6205c-f827-4bc3-8cb6-6a81e673962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71564fbb-9949-489c-a9e5-2bffd586e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71564fbb-9949-489c-a9e5-2bffd586e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-612877287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0b82dc-102a-497e-8672-6883ba24e53f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:01Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6962cfa3-d0b4-42ca-89cb-2288eeecb76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6962cfa3-d0b4-42ca-89cb-2288eeecb76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5cf4e-6fae-4938-b91b-f640d5e0491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5cf4e-6fae-4938-b91b-f640d5e0491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0b82dc-102a-497e-8672-6883ba24e53f', 'volume_name': 'volume-0c0b82dc-102a-497e-8672-6883ba24e53f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d6bc3-583c-4610-94f0-2635784f6ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332d6bc3-583c-4610-94f0-2635784f6ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1632a090-7219-4414-af77-d935395c96ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Volume 0c0b82dc-102a-497e-8672-6883ba24e53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0b82dc-102a-497e-8672-6883ba24e53f', 'volume_size': 1} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-612877287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0b82dc-102a-497e-8672-6883ba24e53f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:01Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Creating volume 0c0b82dc-102a-497e-8672-6883ba24e53f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:00 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:00 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f 1073741824 Jul 08 11:17:00 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "cinder-ab95f954-47d4-485a-9caf-19ae2445fb1c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-ab95f954-47d4-485a-9caf-19ae2445fb1c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:01 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "cinder-quobyte-ab95f954-47d4-485a-9caf-19ae2445fb1c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f 1073741824" returned: 0 in 0.927s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-quobyte-ab95f954-47d4-485a-9caf-19ae2445fb1c" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c16952-6abd-4ff8-b6f4-259fb469014f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:01 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f Jul 08 11:17:01 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:01 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c Jul 08 11:17:01 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:02 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f" returned: 0 in 0.678s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1632a090-7219-4414-af77-d935395c96ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0b82dc-102a-497e-8672-6883ba24e53f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09febaf4-6bab-4248-bda6-82ddc78966e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Volume volume-0c0b82dc-102a-497e-8672-6883ba24e53f (0c0b82dc-102a-497e-8672-6883ba24e53f): created successfully Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09febaf4-6bab-4248-bda6-82ddc78966e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (6eb6205c-f827-4bc3-8cb6-6a81e673962c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-499229cb-8578-43b0-8742-d00fe83807c2 tempest-VolumesTestJSON-1510438054 None] Created volume successfully. Jul 08 11:17:02 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:02 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c Jul 08 11:17:02 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Flow 'volume_create_manager' (7d4fbe5c-d020-4c3b-a948-700bd01a934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4379a0fa-ec2b-4c3b-9c70-3f4839f78ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab95f954-47d4-485a-9caf-19ae2445fb1c" returned: 0 in 0.990s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4379a0fa-ec2b-4c3b-9c70-3f4839f78ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235012640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0218714-95b7-4ea7-9bbc-27cc11ea81b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e82d2bae354497b1da1d42032e2688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:03Z,use_quota=True,user_id='1ecdf54be9a44f0e8dc645f2cd30ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84dc1aa-d757-49e4-99fa-c4c167c6f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84dc1aa-d757-49e4-99fa-c4c167c6f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b237543-cb71-4532-ba15-f61d127f9d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b237543-cb71-4532-ba15-f61d127f9d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0218714-95b7-4ea7-9bbc-27cc11ea81b8', 'volume_name': 'volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85e8fa-700c-4392-9527-9e95d374b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df85e8fa-700c-4392-9527-9e95d374b403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4cefdd-d102-4a73-9de9-ae3466208cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Volume c0218714-95b7-4ea7-9bbc-27cc11ea81b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8', 'volume_size': 1} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235012640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0218714-95b7-4ea7-9bbc-27cc11ea81b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e82d2bae354497b1da1d42032e2688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:03Z,use_quota=True,user_id='1ecdf54be9a44f0e8dc645f2cd30ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Creating volume c0218714-95b7-4ea7-9bbc-27cc11ea81b8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-quobyte-ab95f954-47d4-485a-9caf-19ae2445fb1c" released by "delete_volume" :: held 1.964s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:03 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 1073741824 Jul 08 11:17:03 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Created reservations ['a11b02c1-24d5-4789-a855-2e4cd8f20c76', 'ac447833-dc6e-46e8-9d2c-664327623472', '5344bdd2-f4c1-4853-a193-d7c3214f3c4a', '778e4ca9-7ef0-4804-915c-7c3d346c24aa'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (f09fc35a-8d32-4ec2-a6ff-d20575e0c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8c6242-6595-472a-adf4-9f2ca06a2b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8c6242-6595-472a-adf4-9f2ca06a2b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1000598190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0001b-0529-43c5-ab45-f83262efc530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:04Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706ca950-d865-42f5-b9f3-e5680a1513b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706ca950-d865-42f5-b9f3-e5680a1513b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981ba6e6-6837-4da0-834b-d3a3aa93867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981ba6e6-6837-4da0-834b-d3a3aa93867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e0001b-0529-43c5-ab45-f83262efc530', 'volume_name': 'volume-e1e0001b-0529-43c5-ab45-f83262efc530', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e094c5-b2d2-489f-b18a-03c631fead9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e094c5-b2d2-489f-b18a-03c631fead9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d131c5a8-41a6-4c3e-8666-43335621c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Volume e1e0001b-0529-43c5-ab45-f83262efc530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e0001b-0529-43c5-ab45-f83262efc530', 'volume_size': 1} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:03 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:03 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:04 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 1073741824" returned: 0 in 1.079s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:04 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.838s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:04 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Deleted volume successfully. Jul 08 11:17:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5062a281-e4ae-424f-8718-818755a45a93 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-ab95f954-47d4-485a-9caf-19ae2445fb1c-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:04 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 Jul 08 11:17:04 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Flow 'volume_create_manager' (39d3a56b-1cdd-4243-a7a8-9ba72e2e4da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acfe2e8-c83e-4138-bace-4fe9c4c8bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" returned: 0 in 0.673s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1000598190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0001b-0529-43c5-ab45-f83262efc530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:04Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Creating volume e1e0001b-0529-43c5-ab45-f83262efc530 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:05 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4cefdd-d102-4a73-9de9-ae3466208cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0674a076-6675-4a91-a076-e63f27512386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 1073741824 Jul 08 11:17:05 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acfe2e8-c83e-4138-bace-4fe9c4c8bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2144333290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b991d5a2-2f53-4c6f-bed1-b2fa849d80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695ea5b971f54f6fb1d1258e2f73bc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:05Z,use_quota=True,user_id='34b29b000fea4f2bbccc1f962cd2ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e837742-b9e5-445d-a60c-5372b7beeb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e837742-b9e5-445d-a60c-5372b7beeb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4019222-1686-4850-8b41-809f7d7aa9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4019222-1686-4850-8b41-809f7d7aa9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b991d5a2-2f53-4c6f-bed1-b2fa849d80d2', 'volume_name': 'volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4f12de-e931-49e1-9de7-809ef3a61acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4f12de-e931-49e1-9de7-809ef3a61acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321a9d65-647c-4470-91b1-f5f4ab295240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Volume b991d5a2-2f53-4c6f-bed1-b2fa849d80d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2', 'volume_size': 1} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Volume volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 (c0218714-95b7-4ea7-9bbc-27cc11ea81b8): created successfully Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0674a076-6675-4a91-a076-e63f27512386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Flow 'volume_create_manager' (7d4fbe5c-d020-4c3b-a948-700bd01a934f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-37deb3df-5110-4aab-bb16-9fb709bcef55 tempest-ServersNegativeTestJSON-840054918 None] Created volume successfully. Jul 08 11:17:06 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 1073741824" returned: 0 in 0.830s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:06 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 Jul 08 11:17:06 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:07 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530" returned: 0 in 0.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2144333290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b991d5a2-2f53-4c6f-bed1-b2fa849d80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695ea5b971f54f6fb1d1258e2f73bc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:05Z,use_quota=True,user_id='34b29b000fea4f2bbccc1f962cd2ac5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Creating volume b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:07 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:07 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 1073741824 Jul 08 11:17:07 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d131c5a8-41a6-4c3e-8666-43335621c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e0001b-0529-43c5-ab45-f83262efc530', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c414806a-1d61-48c4-bc17-4fe55798d62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Volume volume-e1e0001b-0529-43c5-ab45-f83262efc530 (e1e0001b-0529-43c5-ab45-f83262efc530): created successfully Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c414806a-1d61-48c4-bc17-4fe55798d62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (f09fc35a-8d32-4ec2-a6ff-d20575e0c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-19118a99-ffac-4fe4-b0d8-765602bb4fd4 tempest-VolumesTestJSON-1510438054 None] Created volume successfully. Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Flow 'volume_create_manager' (63061fc0-d838-4e22-93c1-6c23b57e8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5fd85-03d0-4662-b422-b22c66bce0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b5fd85-03d0-4662-b422-b22c66bce0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-464473598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f66c335-5cf2-4c31-9b90-a85540786db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e82d2bae354497b1da1d42032e2688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:08Z,use_quota=True,user_id='1ecdf54be9a44f0e8dc645f2cd30ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3f400e-5338-4a76-8685-9c2f1c04068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3f400e-5338-4a76-8685-9c2f1c04068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d9053-f57e-4d29-bc38-5c185434d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9d9053-f57e-4d29-bc38-5c185434d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f66c335-5cf2-4c31-9b90-a85540786db2', 'volume_name': 'volume-6f66c335-5cf2-4c31-9b90-a85540786db2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e9b2fd-8a08-4016-880d-daee4b00a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e9b2fd-8a08-4016-880d-daee4b00a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f48ee1-190e-455c-b2a0-2dac88b1764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:07 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Volume 6f66c335-5cf2-4c31-9b90-a85540786db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f66c335-5cf2-4c31-9b90-a85540786db2', 'volume_size': 1} Jul 08 11:17:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:08 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 1073741824" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:08 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 Jul 08 11:17:08 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (58ab5042-3af0-4efc-b112-4dd665ea7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4c4952-8db1-44f8-8a89-26d53593a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4c4952-8db1-44f8-8a89-26d53593a697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639460348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e5df37-045b-45b1-95de-e867c2e10f31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:08Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96d8d2-983a-4e2c-91df-8693cd706261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96d8d2-983a-4e2c-91df-8693cd706261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b00993-926a-4adb-aa7c-a55b622d29f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b00993-926a-4adb-aa7c-a55b622d29f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e5df37-045b-45b1-95de-e867c2e10f31', 'volume_name': 'volume-b8e5df37-045b-45b1-95de-e867c2e10f31', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b211125-39a1-4ac2-9946-9c3846a3e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b211125-39a1-4ac2-9946-9c3846a3e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9eb711a-6b7e-40ae-9ec0-1b99673781a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Volume b8e5df37-045b-45b1-95de-e867c2e10f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e5df37-045b-45b1-95de-e867c2e10f31', 'volume_size': 1} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:08 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" returned: 0 in 0.691s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-464473598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f66c335-5cf2-4c31-9b90-a85540786db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e82d2bae354497b1da1d42032e2688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:08Z,use_quota=True,user_id='1ecdf54be9a44f0e8dc645f2cd30ed52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Creating volume 6f66c335-5cf2-4c31-9b90-a85540786db2 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:08 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321a9d65-647c-4470-91b1-f5f4ab295240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 1073741824 Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c7fc35-90fa-4817-a0d8-7446371eafb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:08 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Volume volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 (b991d5a2-2f53-4c6f-bed1-b2fa849d80d2): created successfully Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c7fc35-90fa-4817-a0d8-7446371eafb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Flow 'volume_create_manager' (39d3a56b-1cdd-4243-a7a8-9ba72e2e4da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-68fcb745-1811-4096-9cc4-836357eb7dfa tempest-VolumesTransfersV355Test-104958176 None] Created volume successfully. Jul 08 11:17:09 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 1073741824" returned: 0 in 0.830s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:09 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 Jul 08 11:17:09 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "cinder-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "cinder-quobyte-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-quobyte-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36445f-cf14-4db5-aba0-03d8dad8c9ca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:10 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 Jul 08 11:17:10 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:10 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2" returned: 0 in 0.694s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639460348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e5df37-045b-45b1-95de-e867c2e10f31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb999328623c4fbea956ed1124884029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:08Z,use_quota=True,user_id='a4949104478f4e4685274c397d22fdf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Creating volume b8e5df37-045b-45b1-95de-e867c2e10f31 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:10 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f48ee1-190e-455c-b2a0-2dac88b1764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f66c335-5cf2-4c31-9b90-a85540786db2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:10 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 1073741824 Jul 08 11:17:10 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd549055-0454-4bcf-ada5-4a04c0e89423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Volume volume-6f66c335-5cf2-4c31-9b90-a85540786db2 (6f66c335-5cf2-4c31-9b90-a85540786db2): created successfully Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd549055-0454-4bcf-ada5-4a04c0e89423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Flow 'volume_create_manager' (63061fc0-d838-4e22-93c1-6c23b57e8f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a220af79-f59f-430e-bccc-028822da3205 tempest-ServersNegativeTestJSON-840054918 None] Created volume successfully. Jul 08 11:17:10 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" returned: 0 in 0.764s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:10 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2 Jul 08 11:17:10 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:11 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 1073741824" returned: 0 in 0.883s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:11 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 Jul 08 11:17:11 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "cinder-6f66c335-5cf2-4c31-9b90-a85540786db2-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-6f66c335-5cf2-4c31-9b90-a85540786db2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "cinder-quobyte-6f66c335-5cf2-4c31-9b90-a85540786db2" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-quobyte-6f66c335-5cf2-4c31-9b90-a85540786db2" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e73aa-cf53-4db6-b591-d7990ea3c612]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:11 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" returned: 0 in 0.731s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-quobyte-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2" released by "delete_volume" :: held 1.539s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:11 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 Jul 08 11:17:11 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Created reservations ['c16f91f3-0dea-49cb-b4c7-f15c06401ea1', 'ee4b100e-ecfa-4f27-b3c4-6877ceeec20a', '0ed7401d-3e08-48d2-84b3-d7d0f76c752e', 'a0fbf0dc-a9c0-4348-9025-34ebbd72f826'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:11 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:11 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:11 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31" returned: 0 in 0.680s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.661s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9eb711a-6b7e-40ae-9ec0-1b99673781a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e5df37-045b-45b1-95de-e867c2e10f31', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e114d0-331a-43c5-9baa-8d396ed986cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e9764-3291-4185-9e5e-cf83b2ec83cc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Volume volume-b8e5df37-045b-45b1-95de-e867c2e10f31 (b8e5df37-045b-45b1-95de-e867c2e10f31): created successfully Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e114d0-331a-43c5-9baa-8d396ed986cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Flow 'volume_create_manager' (58ab5042-3af0-4efc-b112-4dd665ea7add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-23df66d4-4d59-4769-9538-8a8bd4109644 tempest-VolumesTestJSON-1510438054 None] Created volume successfully. Jul 08 11:17:12 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c Jul 08 11:17:12 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:12 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2" returned: 0 in 0.863s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:12 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2 Jul 08 11:17:12 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:12 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.749s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Deleted volume successfully. Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-400fde98-1f94-4109-927f-290dd70e31c2 tempest-VolumesTransfersV355Test-510396648 None] Lock "cinder-b991d5a2-2f53-4c6f-bed1-b2fa849d80d2-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:12 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" returned: 0 in 0.984s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.018s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd01b86c5-cc56-4c0c-ac87-5db32160a470', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:17:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-905c8d7b-25e5-4a28-a2da-f4faf26755e7 req-e61a1e5c-152b-46b1-be18-dd3185dc2656 tempest-TaggedAttachmentsTest-1712347181 None] attachment_update completed successfully. Jul 08 11:17:13 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f66c335-5cf2-4c31-9b90-a85540786db2" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-quobyte-6f66c335-5cf2-4c31-9b90-a85540786db2" released by "delete_volume" :: held 1.749s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Created reservations ['84fa67e2-797b-4e97-ae1c-adb5f350ad9e', 'ec3dc3d2-4374-4811-ac4c-9fcda15430d2', 'd185fa76-4bd6-4530-a886-898e7f559763', 'd4ca4a54-3b58-4204-812a-dbbf5e51cd60'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:13 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:13 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "cinder-c0218714-95b7-4ea7-9bbc-27cc11ea81b8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-c0218714-95b7-4ea7-9bbc-27cc11ea81b8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "cinder-quobyte-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-quobyte-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04de30-1596-464d-a2c1-784d8d73b8cf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:14 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 Jul 08 11:17:14 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:14 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-b8e5df37-045b-45b1-95de-e867c2e10f31-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.864s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Deleted volume successfully. Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "cinder-b8e5df37-045b-45b1-95de-e867c2e10f31-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4a6e867-b6d7-4a83-9651-e9738727f5ae tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-6f66c335-5cf2-4c31-9b90-a85540786db2-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-quobyte-b8e5df37-045b-45b1-95de-e867c2e10f31" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-b8e5df37-045b-45b1-95de-e867c2e10f31" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[104e8964-1193-451e-ad22-d9223a1fce54]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:14 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 Jul 08 11:17:14 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:14 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" returned: 0 in 0.955s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:14 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8 Jul 08 11:17:14 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:15 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31" returned: 0 in 0.842s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:15 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31 Jul 08 11:17:15 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:15 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-quobyte-c0218714-95b7-4ea7-9bbc-27cc11ea81b8" released by "delete_volume" :: held 1.754s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Created reservations ['c620fb3d-b55b-4179-916b-00e58c8932bb', 'a1412678-2fe9-4f76-ad61-eb95cfd9201d', 'ff79dc9c-e0dc-4cd8-8c9c-0cbb5e6857f0', '2d24e1e5-b065-4b4e-b856-ef6d1d3ad9af'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:15 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:15 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:15 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b8e5df37-045b-45b1-95de-e867c2e10f31" returned: 0 in 0.724s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-b8e5df37-045b-45b1-95de-e867c2e10f31" released by "delete_volume" :: held 1.616s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Created reservations ['0dd3fcc6-2580-46d3-a4b3-e558afa4d9d7', '99a7777a-2ca2-45cb-b09d-b48d0fbe1acb', 'c9d11f3f-4e97-4fd4-9cb7-11059550b5bb', 'ebd3da74-0d98-4d39-9b6d-933aadd4820f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:16 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:16 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-e1e0001b-0529-43c5-ab45-f83262efc530-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:16 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.872s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "cinder-e1e0001b-0529-43c5-ab45-f83262efc530-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Deleted volume successfully. Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c7efdb4c-e95a-4afc-9aa9-438bbdcceea2 tempest-ServersNegativeTestJSON-840054918 None] Lock "cinder-c0218714-95b7-4ea7-9bbc-27cc11ea81b8-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-quobyte-e1e0001b-0529-43c5-ab45-f83262efc530" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-e1e0001b-0529-43c5-ab45-f83262efc530" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b4ad82-1e4b-41ab-ab92-20b67dd20fc8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:16 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 Jul 08 11:17:16 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:17 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.889s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:17 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:17 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Deleted volume successfully. Jul 08 11:17:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d95148dd-1d3e-40b2-afcd-fa34750aceec tempest-VolumesTestJSON-1510438054 None] Lock "cinder-b8e5df37-045b-45b1-95de-e867c2e10f31-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:17 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530" returned: 0 in 0.894s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:17 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530 Jul 08 11:17:17 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:18 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e1e0001b-0529-43c5-ab45-f83262efc530" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-e1e0001b-0529-43c5-ab45-f83262efc530" released by "delete_volume" :: held 1.968s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Created reservations ['edf2c0cc-fb0a-4371-a193-9351a8a1fc23', '0601052a-c2b4-4899-9a3a-91cb0fe8d986', '7673d900-33b6-45ee-a384-2228ea61a9cc', 'bb9ee6c8-8506-40db-95aa-196c79c86368'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:18 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:18 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-0c0b82dc-102a-497e-8672-6883ba24e53f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "cinder-0c0b82dc-102a-497e-8672-6883ba24e53f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Acquiring lock "cinder-quobyte-0c0b82dc-102a-497e-8672-6883ba24e53f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-0c0b82dc-102a-497e-8672-6883ba24e53f" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7b6ad-e32b-47c5-8052-f304c586d4a9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:19 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f Jul 08 11:17:19 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Flow 'volume_create_manager' (15e1e39c-07fc-4300-8c96-aad2ef5aa7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a400f1-bb94-4dd0-8bba-6b5a7133f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a400f1-bb94-4dd0-8bba-6b5a7133f75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1997066644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2be73d593944d98ece2fa77ba7a956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:19Z,use_quota=True,user_id='47942bb82e3f47d4a214983154c30810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89319df2-b389-4451-81a9-209bf9f8228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89319df2-b389-4451-81a9-209bf9f8228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d321e-d851-4721-b53b-7bd333507162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d321e-d851-4721-b53b-7bd333507162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd', 'volume_name': 'volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd', 'volume_size': 2}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cca3194-1182-44fc-9cb3-9f16953da899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cca3194-1182-44fc-9cb3-9f16953da899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be33652-27c0-4399-ac05-6263a40cd965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Volume f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd', 'volume_size': 2} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1997066644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2be73d593944d98ece2fa77ba7a956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:19Z,use_quota=True,user_id='47942bb82e3f47d4a214983154c30810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Creating volume f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:19 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd 2147483648 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:19 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd 2147483648 Jul 08 11:17:19 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:19 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.075s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Deleted volume successfully. Jul 08 11:17:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-df4918d4-bbf0-41df-b648-44b3119baa52 tempest-VolumesTestJSON-1510438054 None] Lock "cinder-e1e0001b-0529-43c5-ab45-f83262efc530-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:20 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f" returned: 0 in 1.119s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:20 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f Jul 08 11:17:20 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-a70f160e-8f76-40d8-afd0-31ec1b152b7b req-9ffd832c-b7df-4374-8726-a51245275267 tempest-TaggedAttachmentsTest-1712347181 None] Terminate volume connection completed successfully. Jul 08 11:17:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-a70f160e-8f76-40d8-afd0-31ec1b152b7b req-9ffd832c-b7df-4374-8726-a51245275267 tempest-TaggedAttachmentsTest-1712347181 None] Deleting attachment d01b86c5-cc56-4c0c-ac87-5db32160a470. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:17:20 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd 2147483648" returned: 0 in 0.995s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:20 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd Jul 08 11:17:20 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:21 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0c0b82dc-102a-497e-8672-6883ba24e53f" returned: 0 in 0.838s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "cinder-quobyte-0c0b82dc-102a-497e-8672-6883ba24e53f" released by "delete_volume" :: held 2.016s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Created reservations ['d3948781-1bce-4cac-9824-386544022a21', 'e05e0c28-bd4f-4e8b-9b7a-47105bb4c130', 'ffe754cf-a89f-4cfc-864e-eb989dff05db', 'cad8a9d2-3d26-4015-b5b5-1de44aca82bf'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:21 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:21 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:21 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" returned: 0 in 0.845s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be33652-27c0-4399-ac05-6263a40cd965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd', 'volume_size': 2}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51480561-de20-43f1-9d58-f29a4f5a3804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Volume volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd (f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd): created successfully Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51480561-de20-43f1-9d58-f29a4f5a3804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Flow 'volume_create_manager' (15e1e39c-07fc-4300-8c96-aad2ef5aa7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-095919bc-2c0b-44be-95a0-5b60816a80ab tempest-VolumesCloneNegativeTest-1842493848 None] Created volume successfully. Jul 08 11:17:21 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.720s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Deleted volume successfully. Jul 08 11:17:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-828276da-303d-4e7e-8a76-f748d1bfb42c tempest-VolumesTestJSON-1510438054 None] Lock "cinder-0c0b82dc-102a-497e-8672-6883ba24e53f-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Acquiring lock "cinder-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "cinder-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Acquiring lock "cinder-quobyte-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "cinder-quobyte-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a9da8-f9df-4358-910c-8583ad58a316]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:23 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd Jul 08 11:17:23 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:23 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" returned: 0 in 0.944s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:23 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd Jul 08 11:17:23 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:24 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" returned: 0 in 0.726s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "cinder-quobyte-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd" released by "delete_volume" :: held 1.772s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Created reservations ['eda202b2-744a-4a63-b761-94988aedce62', '032f9d7f-c036-4d14-ba10-df74dd568065', 'c0c992b7-dc60-4297-b3d1-01b6d83023d0', '21f3a107-f2b8-4669-b540-89eb5971f93c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:24 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:24 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:25 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:25 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Deleted volume successfully. Jul 08 11:17:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c212f8cb-cb19-4838-8eba-b4699f3a380f tempest-VolumesCloneNegativeTest-1842493848 None] Lock "cinder-f3c5c71d-7f41-4c3e-967d-9b6fe124a6fd-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3289369f-9072-4344-bb74-051a9796e6d8 tempest-BackendsCapabilitiesAdminTestsJSON-1518274827 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7354888916016, 'free_capacity_gb': 1775.7354888916016, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86852) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 11:17:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a5fe89b0-814f-4adf-b071-f20810bf221a tempest-BackendsCapabilitiesAdminTestsJSON-1518274827 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7354888916016, 'free_capacity_gb': 1775.7354888916016, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86852) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Flow 'volume_create_manager' (c6267f03-082f-40e1-a90d-555aa088dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2025665b-3186-4100-b45d-91c73b57f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2025665b-3186-4100-b45d-91c73b57f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-47260360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497e3fb5-9159-4043-bde4-85fe385308c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c73deea43244a04961a920fd24fe3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:29Z,use_quota=True,user_id='954e1b29668e4465a485cdb63a24db22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fa81c8-dd88-4674-8095-e281d13e648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fa81c8-dd88-4674-8095-e281d13e648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b32af47-36e2-41ab-bc99-7c64be220d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:29 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b32af47-36e2-41ab-bc99-7c64be220d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '497e3fb5-9159-4043-bde4-85fe385308c3', 'volume_name': 'volume-497e3fb5-9159-4043-bde4-85fe385308c3', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1782c9-e7ce-473a-8bf7-c157534a7dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1782c9-e7ce-473a-8bf7-c157534a7dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26964643-50da-4424-ba19-7b882478985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:30 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Volume 497e3fb5-9159-4043-bde4-85fe385308c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-497e3fb5-9159-4043-bde4-85fe385308c3', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Trying to clone 497e3fb5-9159-4043-bde4-85fe385308c3 from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:17:30 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Image download 20.69 MB at 20.69 MB/s Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[20240652-2d86-4d8c-9909-c572bd37fcf7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:31 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD Jul 08 11:17:31 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:31 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD" returned: 0 in 0.970s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:31 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 is fetched for user 954e1b29668e4465a485cdb63a24db22. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:17:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05a3c1-f8e7-4f44-955f-598d960d6169]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:32 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD Jul 08 11:17:32 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:33 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD" returned: 0 in 1.034s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-47260360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497e3fb5-9159-4043-bde4-85fe385308c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c73deea43244a04961a920fd24fe3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:29Z,use_quota=True,user_id='954e1b29668e4465a485cdb63a24db22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Creating volume 497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:33 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:33 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1073741824 Jul 08 11:17:33 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:34 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1073741824" returned: 0 in 1.049s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:34 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:34 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:34 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:34 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Attempting download of 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 497e3fb5-9159-4043-bde4-85fe385308c3. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:17:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[70528429-71ee-4134-8a4b-b13c275ba5f8]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:35 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po Jul 08 11:17:35 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:35 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po" returned: 0 in 0.843s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:36 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po Jul 08 11:17:36 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-aafc8ecf-87ed-4c2c-90a4-145f4e6e5369 tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-291067021: creating Jul 08 11:17:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-aafc8ecf-87ed-4c2c-90a4-145f4e6e5369 tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-291067021: created successfully Jul 08 11:17:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-aafc8ecf-87ed-4c2c-90a4-145f4e6e5369 tempest-GroupSnapshotsTest-1440644260 None] Create group completed successfully. Jul 08 11:17:36 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po" returned: 1 in 0.778s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_joj201po' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:17:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca3d47-7ff2-4455-81ef-8217f2eb12cb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:36 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD Jul 08 11:17:36 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:37 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:37 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] 9c13436c-39fd-4e1e-9478-9ae05ec64994 was qcow2, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:17:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:37 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:37 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (0bb45387-132e-478a-af91-631a7fe3789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565574c7-32f1-41be-92d8-51254c43c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565574c7-32f1-41be-92d8-51254c43c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814731966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2635a1d-39fe-4d59-b783-2a19cdabbd3a,host='devstack@QuobyteHD#QuobyteHD',id=3be6bfbf-d8eb-461e-b9f5-b4697a72c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:38Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91b3fbf1-c5bf-4a50-b33c-b49c685f83f7),volume_type_id=91b3fbf1-c5bf-4a50-b33c-b49c685f83f7)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc49fc-1d81-4b26-a3e4-c14d87f436ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9dc49fc-1d81-4b26-a3e4-c14d87f436ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff26b0da-f1e5-4c4c-be47-4503627a24ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff26b0da-f1e5-4c4c-be47-4503627a24ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be6bfbf-d8eb-461e-b9f5-b4697a72c715', 'volume_name': 'volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d19ac1-f280-4283-916d-51cd93fdf50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d19ac1-f280-4283-916d-51cd93fdf50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62167075-8337-4cb7-882b-fb8a800faa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:38 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Volume 3be6bfbf-d8eb-461e-b9f5-b4697a72c715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715', 'volume_size': 1} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2635a1d-39fe-4d59-b783-2a19cdabbd3a,created_at=2026-07-08T09:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814731966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2635a1d-39fe-4d59-b783-2a19cdabbd3a,host='devstack@QuobyteHD#QuobyteHD',id=3be6bfbf-d8eb-461e-b9f5-b4697a72c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:38Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91b3fbf1-c5bf-4a50-b33c-b49c685f83f7),volume_type_id=91b3fbf1-c5bf-4a50-b33c-b49c685f83f7)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Creating volume 3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:38 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:38 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 1073741824 Jul 08 11:17:38 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:39 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 1073741824" returned: 0 in 1.203s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:39 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:17:39 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "cinder-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "cinder-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "cinder-quobyte-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "cinder-quobyte-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59696a-4ecb-4895-b6b2-47736f340a65]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:40 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c Jul 08 11:17:40 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:40 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 0.833s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62167075-8337-4cb7-882b-fb8a800faa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb12777-c6cb-484d-b58a-878099212ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:40 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 2.685s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_tbhzf14idevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:17:40 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Converted 112.00 MB image at 41.69 MB/s Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:40 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Volume volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 (3be6bfbf-d8eb-461e-b9f5-b4697a72c715): created successfully Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb12777-c6cb-484d-b58a-878099212ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:40 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1G Jul 08 11:17:40 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (0bb45387-132e-478a-af91-631a7fe3789f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bb2750d2-ceee-46aa-a258-4bce5a0cb364 tempest-GroupSnapshotsTest-1440644260 None] Created volume successfully. Jul 08 11:17:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] GroupSnapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: creating. Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Group snapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: creating. {{(pid=86852) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:41 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" returned: 0 in 1.024s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Creating offline snapshot 187d7128-b1a2-4596-99e0-67e2dbd6d88d of volume 3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:17:41 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c Jul 08 11:17:41 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88bc82-c907-43be-b330-722e3e3f16e4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:41 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 1G" returned: 0 in 0.843s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[36859713-07c9-4c7f-acfd-2ce5af93ae13]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:41 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:17:41 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:41 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:41 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:41 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" returned: 0 in 0.740s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "cinder-quobyte-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c" released by "delete_volume" :: held 1.816s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Created reservations ['e375cfe4-224e-4206-a0de-41d299b1132f', '47f51a97-283c-482b-ad67-4e5e28da3798', '3885dffc-fdae-4097-b2a7-c3541ea044b5', '79b4458d-7ee8-44b2-b0dc-6357eed984bb'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:41 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:41 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:42 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 0.959s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:42 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 1.087s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:42 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d 1G Jul 08 11:17:42 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:42 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:42 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:42 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.922s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Deleted volume successfully. Jul 08 11:17:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3adbfcc3-7074-463f-b910-6920687e97f9 tempest-TaggedAttachmentsTest-1712347181 None] Lock "cinder-11efb6f0-a4ef-4c54-acb6-e99c3e6fd73c-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:43 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 1 in 1.056s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Downloaded image 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 497e3fb5-9159-4043-bde4-85fe385308c3 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 for user 954e1b29668e4465a485cdb63a24db22 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Marking volume 497e3fb5-9159-4043-bde4-85fe385308c3 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:17:43 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d 1G" returned: 0 in 1.055s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Copying metadata from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 to 497e3fb5-9159-4043-bde4-85fe385308c3. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Creating volume glance metadata for volume 497e3fb5-9159-4043-bde4-85fe385308c3 backed by image 9c13436c-39fd-4e1e-9478-9ae05ec64994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:17:43 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:17:43 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26964643-50da-4424-ba19-7b882478985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497e3fb5-9159-4043-bde4-85fe385308c3', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc7caf-586b-4c56-97a0-acea1ba1a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:43 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Volume volume-497e3fb5-9159-4043-bde4-85fe385308c3 (497e3fb5-9159-4043-bde4-85fe385308c3): created successfully Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc7caf-586b-4c56-97a0-acea1ba1a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Flow 'volume_create_manager' (c6267f03-082f-40e1-a90d-555aa088dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:43 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-26215a70-951c-49fe-9839-1d43dca7c32f tempest-VolumesExtendTest-352568994 None] Created volume successfully. Jul 08 11:17:44 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 0.823s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:44 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:17:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:44 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:17:44 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:44 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:44 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info Jul 08 11:17:44 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:45 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info" returned: 0 in 0.918s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:45 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:17:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:45 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info Jul 08 11:17:45 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:46 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.info" returned: 0 in 0.758s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.467s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.754s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:INSERT=36,cinder:UPDATE=127,cinder:SELECT=91,cinder:DELETE=7 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=118,cinder:DELETE=14 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d060c31-47cc-4117-ae0c-04885ef643aa]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7ce62261-a697-40a4-a98c-a3b958aee496 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: created successfully Jul 08 11:17:46 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:46 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:47 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 0.993s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:47 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:47 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:48 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 1 in 0.974s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 2G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 2G" returned: 0 in 0.118s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.157s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d-f6604b3a-52c0-4952-b8ca-2fa64302454b" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d-f6604b3a-52c0-4952-b8ca-2fa64302454b" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Creating volume f6604b3a-52c0-4952-b8ca-2fa64302454b from snapshot 187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:48 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5ebdcca5-8cf6-4af7-b83f-db3a1cb60717 tempest-VolumesExtendTest-352568994 None] Extend volume completed successfully. Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] snapshot: 187d7128-b1a2-4596-99e0-67e2dbd6d88d, volume: f6604b3a-52c0-4952-b8ca-2fa64302454b, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c064d84-0c06-4c5c-8bab-335233700d74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:49 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:17:49 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-497e3fb5-9159-4043-bde4-85fe385308c3-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "cinder-497e3fb5-9159-4043-bde4-85fe385308c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-quobyte-497e3fb5-9159-4043-bde4-85fe385308c3" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-497e3fb5-9159-4043-bde4-85fe385308c3" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0275a2-c67a-46d4-bdba-0b45a6115829]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:49 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:49 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:49 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 0.903s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30a955-971c-4b31-a38d-2a0a55162a74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:49 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:17:49 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:50 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 0.978s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:50 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:50 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:50 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 0.934s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:50 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:17:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:50 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b Jul 08 11:17:50 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:51 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 1 in 0.932s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:17:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:51 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3 Jul 08 11:17:51 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:52 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:52 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:53 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-497e3fb5-9159-4043-bde4-85fe385308c3" returned: 0 in 1.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-497e3fb5-9159-4043-bde4-85fe385308c3" released by "delete_volume" :: held 3.840s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Created reservations ['4d7cb031-8cef-4586-89db-5c0bec2e2064', '7acb67e8-60f6-46f2-9ee0-591bad11392d', 'dea7584b-0730-4f08-9b63-4f671e28743a', '18eec20c-7f4f-4a1b-a607-bd1c7beeffc4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:53 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:17:53 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:54 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.982s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:54 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:54 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:17:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:17:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:17:55 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.469s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:17:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Deleted volume successfully. Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-51437e04-6636-4061-9741-0ebed98d139c tempest-VolumesExtendTest-352568994 None] Lock "cinder-497e3fb5-9159-4043-bde4-85fe385308c3-delete_volume" released by "delete_volume" :: held 5.850s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Flow 'volume_create_manager' (7cef6b0d-b31b-4f89-bd43-ca89d323e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57518522-b841-4569-b267-ef4fb85492e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57518522-b841-4569-b267-ef4fb85492e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1501154748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73205084-12ef-484c-8055-0c6f2b3172ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c73deea43244a04961a920fd24fe3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:56Z,use_quota=True,user_id='954e1b29668e4465a485cdb63a24db22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c342f589-95a0-4849-a534-f341b8a1d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c342f589-95a0-4849-a534-f341b8a1d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad383eb8-8de7-48f9-ba94-6a2dda480e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad383eb8-8de7-48f9-ba94-6a2dda480e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73205084-12ef-484c-8055-0c6f2b3172ae', 'volume_name': 'volume-73205084-12ef-484c-8055-0c6f2b3172ae', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b514e-0f18-4843-a108-bc0fc2b27a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b514e-0f18-4843-a108-bc0fc2b27a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:17:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dabf9d-8849-495d-97cd-224f9a513dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:17:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Volume 73205084-12ef-484c-8055-0c6f2b3172ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73205084-12ef-484c-8055-0c6f2b3172ae', 'volume_size': 1} Jul 08 11:17:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:57 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b" returned: 0 in 6.872s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[01360658-fd61-48fb-a769-73e90ab3bf9d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:17:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:57 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:17:57 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:58 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 1.120s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:58 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:17:58 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Converted 1024.00 MB image at 148.99 MB/s Jul 08 11:17:58 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:17:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:58 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b Jul 08 11:17:58 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:59 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b" returned: 0 in 0.801s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" released by "_copy_volume_from_snapshot" :: held 10.755s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d-f6604b3a-52c0-4952-b8ca-2fa64302454b" released by "_create_volume_from_snapshot" :: held 10.821s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.855s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1501154748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73205084-12ef-484c-8055-0c6f2b3172ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c73deea43244a04961a920fd24fe3e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:17:56Z,use_quota=True,user_id='954e1b29668e4465a485cdb63a24db22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Creating volume 73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:17:59 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:17:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:17:59 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae 1073741824 Jul 08 11:17:59 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:17:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-19cf17dc-0e1a-4ea4-b7d0-e6c882f7d675 tempest-GroupSnapshotsTest-1440644260 None] Create group from source-snapshot-7cd368e3-abd8-4acd-846d-81e218d4a4ae completed successfully. Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56267b5-3803-45cd-b22a-ad936acc4a88]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:00 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b Jul 08 11:18:00 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:00 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae 1073741824" returned: 0 in 1.035s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:00 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:00 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:01 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b" returned: 0 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:01 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b Jul 08 11:18:01 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:01 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 0.752s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dabf9d-8849-495d-97cd-224f9a513dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73205084-12ef-484c-8055-0c6f2b3172ae', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c453c-e3c6-42d1-9312-0969aa91f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:01 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Volume volume-73205084-12ef-484c-8055-0c6f2b3172ae (73205084-12ef-484c-8055-0c6f2b3172ae): created successfully Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c453c-e3c6-42d1-9312-0969aa91f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Flow 'volume_create_manager' (7cef6b0d-b31b-4f89-bd43-ca89d323e392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:01 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5137d264-1c30-4624-869d-2185b0ea9f37 tempest-VolumesExtendTest-352568994 None] Created volume successfully. Jul 08 11:18:02 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f6604b3a-52c0-4952-b8ca-2fa64302454b" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-f6604b3a-52c0-4952-b8ca-2fa64302454b" released by "delete_volume" :: held 1.647s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Creating offline snapshot d297addf-4fe2-4ab1-a749-59972504a74c of volume 73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d2de8-8ece-463b-b52e-455917236a58]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['73e7edd7-e643-4377-9012-94bacdf37c0f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:02 devstack cinder-volume[86852]: WARNING cinder.quota [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-717959630 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-717959630, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:02 devstack cinder-volume[86852]: WARNING cinder.quota [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-717959630 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-717959630, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['6ec22534-b908-4e5f-b9fb-8710ae717ee6', 'cae9f67c-cfae-4482-84a3-c12b7472fa1d', '135f1b7e-3ac9-459c-be56-bc3fb777ae1a', '42e0fd33-eff3-41cb-af0a-664aeb67ac12'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:02 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:02 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:02 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:02 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: deleting Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: deleting {{(pid=86852) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Deleting offline snapshot 187d7128-b1a2-4596-99e0-67e2dbd6d88d of volume 3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] snapshot_file for this snap is: volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd77e56-99b2-4fce-b4d2-624634747f72]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:03 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 1.133s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:03 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:18:03 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c 1G Jul 08 11:18:03 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:03 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:03 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.085s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:03 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a4785f62-2c9d-4150-b85d-d577a6d3b901 tempest-GroupSnapshotsTest-1440644260 None] Delete group completed successfully. Jul 08 11:18:04 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 1.387s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db6bfc-f8f6-4797-8cca-fb01f9c03399]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:04 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c 1G" returned: 0 in 1.225s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73205084-12ef-484c-8055-0c6f2b3172ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:04 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73205084-12ef-484c-8055-0c6f2b3172ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c Jul 08 11:18:04 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:04 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:18:04 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:05 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 0.932s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:05 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73205084-12ef-484c-8055-0c6f2b3172ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c" returned: 0 in 0.872s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:05 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c is being set with open permissions: ugo+rw Jul 08 11:18:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:05 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:18:05 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:05 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c Jul 08 11:18:05 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:06 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c" returned: 0 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:06 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info Jul 08 11:18:06 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:06 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 1.187s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:06 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d Jul 08 11:18:06 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:07 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info" returned: 0 in 0.840s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:07 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info is being set with open permissions: ugo+rw Jul 08 11:18:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:07 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info Jul 08 11:18:07 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:08 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715.187d7128-b1a2-4596-99e0-67e2dbd6d88d" returned: 0 in 1.569s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-187d7128-b1a2-4596-99e0-67e2dbd6d88d" released by "_delete_snapshot" :: held 5.256s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" released by "delete_snapshot" :: held 5.296s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:08 devstack cinder-volume[86852]: WARNING cinder.quota [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-717959630 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-717959630, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['ab52de24-b495-4bfd-bd07-2f9230cbbacf', '20f04bfd-0fed-496b-82b6-bee948fb5ca4', '30e835c3-f9c4-47b5-abd2-c2f33f757a7e', 'f66f7ed4-8e8c-4c28-a807-15fc6049506c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a63b32c9-704b-48c7-8dcd-54a49da7d3ad tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 7cd368e3-abd8-4acd-846d-81e218d4a4ae: deleted successfully Jul 08 11:18:08 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.info" returned: 0 in 1.331s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.538s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3fadcf82-70ed-4ab3-8d4b-89eecc45b6eb tempest-VolumesExtendTest-352568994 None] Create snapshot completed successfully Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" acquired by "delete_volume" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb0c56-f05f-429d-b74b-77e4b7a68331]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:09 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:18:09 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ee1356-7461-484e-a42c-9742c90f50e1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:10 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:10 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:10 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 1.202s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:10 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715 Jul 08 11:18:10 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:11 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 1.299s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c 2G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c 2G" returned: 0 in 0.206s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.583s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e856ad98-2f50-438a-9467-eb51031d3226 tempest-VolumesExtendTest-352568994 None] Extend volume completed successfully. Jul 08 11:18:11 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" returned: 0 in 1.040s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-3be6bfbf-d8eb-461e-b9f5-b4697a72c715" released by "delete_volume" :: held 2.370s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['583ff185-c2bc-468d-9e32-b8e2f4b6a5f0'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:11 devstack cinder-volume[86852]: WARNING cinder.db.api [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-717959630'] Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['6882a082-0526-4ee5-8be4-63fedb7c37f7', '6d3ca7e5-a424-49bd-a64a-3bdf89c78857', '112e937f-2860-47c7-8e49-094ebd1552b8', '87369c4f-965a-47d9-a7a9-d88b10c18de4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:11 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:11 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-d297addf-4fe2-4ab1-a749-59972504a74c-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-d297addf-4fe2-4ab1-a749-59972504a74c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-quobyte-d297addf-4fe2-4ab1-a749-59972504a74c" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-d297addf-4fe2-4ab1-a749-59972504a74c" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Deleting offline snapshot d297addf-4fe2-4ab1-a749-59972504a74c of volume 73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] snapshot_file for this snap is: volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1869d10-2a84-4b0a-b700-55cc3573eb2a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:12 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:12 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e7feba13-75d5-4bee-b45c-8409ab5f20ed tempest-GroupSnapshotsTest-1440644260 None] Delete group completed successfully. Jul 08 11:18:12 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c Jul 08 11:18:12 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-654a15f9-7e6c-44e2-9890-db4820783965 tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-154622735: creating Jul 08 11:18:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-654a15f9-7e6c-44e2-9890-db4820783965 tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-154622735: created successfully Jul 08 11:18:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-654a15f9-7e6c-44e2-9890-db4820783965 tempest-GroupSnapshotsTest-1440644260 None] Create group completed successfully. Jul 08 11:18:13 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c" returned: 0 in 0.883s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73205084-12ef-484c-8055-0c6f2b3172ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe359b-5c96-4cfe-beed-b40f96bd29db]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:13 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:13 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:14 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 1.038s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:14 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c Jul 08 11:18:14 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (36b1b1e6-70c1-4811-ba7c-ccfd0f053d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bc9606-ebfc-4ceb-a8a3-1cb7b57ef372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bc9606-ebfc-4ceb-a8a3-1cb7b57ef372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6388988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,host='devstack@QuobyteHD#QuobyteHD',id=34c546f5-b0d8-431e-a0ec-058b0a0b3dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:15Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26cf0db6-c687-4c7a-9be9-2663125b6866),volume_type_id=26cf0db6-c687-4c7a-9be9-2663125b6866)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4857a467-1888-462f-bd11-f5e648ecc548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4857a467-1888-462f-bd11-f5e648ecc548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a4a8d2-bf4a-4847-be76-7c64653b33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a4a8d2-bf4a-4847-be76-7c64653b33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c546f5-b0d8-431e-a0ec-058b0a0b3dea', 'volume_name': 'volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533c8c0b-47a1-40cb-ba37-5aa6f14e96ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533c8c0b-47a1-40cb-ba37-5aa6f14e96ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ac0312-a2c3-4d81-a592-5989db66db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Volume 34c546f5-b0d8-431e-a0ec-058b0a0b3dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea', 'volume_size': 1} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,created_at=2026-07-08T09:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6388988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,host='devstack@QuobyteHD#QuobyteHD',id=34c546f5-b0d8-431e-a0ec-058b0a0b3dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:15Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26cf0db6-c687-4c7a-9be9-2663125b6866),volume_type_id=26cf0db6-c687-4c7a-9be9-2663125b6866)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Creating volume 34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:15 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:15 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea 1073741824 Jul 08 11:18:15 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:15 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c" returned: 0 in 1.145s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:15 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c Jul 08 11:18:15 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:16 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea 1073741824" returned: 0 in 1.099s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:16 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea Jul 08 11:18:16 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:16 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae.d297addf-4fe2-4ab1-a749-59972504a74c" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-d297addf-4fe2-4ab1-a749-59972504a74c" released by "_delete_snapshot" :: held 4.033s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" released by "delete_snapshot" :: held 4.097s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Created reservations ['2a2e2c34-0ac9-4026-a698-e9645996aa6b', 'a552148f-5df2-4b58-bb1e-c75ef45e1218', '0f0ebf10-82fb-4784-a206-51da8878d247', 'c90284b9-fa34-45af-922d-a574cc8c92ef'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Delete snapshot completed successfully. Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-76440006-c79d-418e-b03c-657700c37f1b tempest-VolumesExtendTest-352568994 None] Lock "cinder-d297addf-4fe2-4ab1-a749-59972504a74c-delete_snapshot" released by "delete_snapshot" :: held 4.350s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-73205084-12ef-484c-8055-0c6f2b3172ae-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "cinder-73205084-12ef-484c-8055-0c6f2b3172ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Acquiring lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3032be9-5650-4a47-bfc8-98ea389c444d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:17 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" returned: 0 in 0.937s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:17 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:17 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ac0312-a2c3-4d81-a592-5989db66db54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc6cec-b93b-4f73-97f1-99b6ae70ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:17 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Volume volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea (34c546f5-b0d8-431e-a0ec-058b0a0b3dea): created successfully Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cc6cec-b93b-4f73-97f1-99b6ae70ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (36b1b1e6-70c1-4811-ba7c-ccfd0f053d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:17 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f06cc38a-c554-4e79-bfd2-9ce00f3fdd4a tempest-GroupSnapshotsTest-1440644260 None] Created volume successfully. Jul 08 11:18:17 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 0.876s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:17 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae Jul 08 11:18:17 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:18 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-73205084-12ef-484c-8055-0c6f2b3172ae" returned: 0 in 0.737s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "cinder-quobyte-73205084-12ef-484c-8055-0c6f2b3172ae" released by "delete_volume" :: held 1.700s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Created reservations ['8112be37-7830-40c9-881d-a810bb09caf5', '7b80719a-8cab-402a-92fc-d21a7522b534', '5aa722f1-3efe-478d-a1c3-ef4ad3add949', 'aa864b9a-038d-4291-92a4-4f3585597c9c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:18 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:18 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (d0bab644-de3f-4e8c-b28a-aba9504af67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd957c96-b176-4d3d-9145-af354b50fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd957c96-b176-4d3d-9145-af354b50fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803688361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,host='devstack@QuobyteHD#QuobyteHD',id=9121c4c9-68c9-41e9-96bc-027a56edb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:19Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26cf0db6-c687-4c7a-9be9-2663125b6866),volume_type_id=26cf0db6-c687-4c7a-9be9-2663125b6866)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1f6d22-60fa-4097-8510-2337ba699331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1f6d22-60fa-4097-8510-2337ba699331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee32060a-4a9b-4ff1-b105-a8c58e09f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee32060a-4a9b-4ff1-b105-a8c58e09f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9121c4c9-68c9-41e9-96bc-027a56edb04b', 'volume_name': 'volume-9121c4c9-68c9-41e9-96bc-027a56edb04b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f34b86f-8da8-4c95-8b2f-df023c1f9d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f34b86f-8da8-4c95-8b2f-df023c1f9d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8e0ac0-a0b4-491f-9af6-44362100228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Volume 9121c4c9-68c9-41e9-96bc-027a56edb04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9121c4c9-68c9-41e9-96bc-027a56edb04b', 'volume_size': 1} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,created_at=2026-07-08T09:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803688361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0164dec-50fb-464f-aca5-b0a37acabbc6,host='devstack@QuobyteHD#QuobyteHD',id=9121c4c9-68c9-41e9-96bc-027a56edb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:19Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26cf0db6-c687-4c7a-9be9-2663125b6866),volume_type_id=26cf0db6-c687-4c7a-9be9-2663125b6866)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Creating volume 9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:19 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:19 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b 1073741824 Jul 08 11:18:19 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:19 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.969s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Deleted volume successfully. Jul 08 11:18:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-409eff2d-cf8c-4cac-aba3-5279acb3b901 tempest-VolumesExtendTest-352568994 None] Lock "cinder-73205084-12ef-484c-8055-0c6f2b3172ae-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:20 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b 1073741824" returned: 0 in 1.010s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:20 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b Jul 08 11:18:20 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:21 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b" returned: 0 in 0.678s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8e0ac0-a0b4-491f-9af6-44362100228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9121c4c9-68c9-41e9-96bc-027a56edb04b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d12416-9c54-4252-8d19-9dad7cc72e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Volume volume-9121c4c9-68c9-41e9-96bc-027a56edb04b (9121c4c9-68c9-41e9-96bc-027a56edb04b): created successfully Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d12416-9c54-4252-8d19-9dad7cc72e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (d0bab644-de3f-4e8c-b28a-aba9504af67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-96d17cdd-cbab-485c-83a7-673ca4e28f32 tempest-GroupSnapshotsTest-1440644260 None] Created volume successfully. Jul 08 11:18:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f9024801-023b-4ce2-921f-9e5695a046cb tempest-GroupSnapshotsTest-1440644260 None] Update group completed successfully. Jul 08 11:18:23 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-89de34aa-7e64-4ac1-8376-fca4b68570b1 tempest-GroupSnapshotsTest-1440644260 None] Update group completed successfully. Jul 08 11:18:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a8f724f1-603d-45b9-84b0-01e8c65c4d40 tempest-GroupSnapshotsTest-1440644260 None] Update group completed successfully. Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Flow 'volume_create_manager' (528e3c0d-4ccb-4ad4-a2e4-f85becf82746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d09ebe4-698a-4a6d-824c-4ce9d0761184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d09ebe4-698a-4a6d-824c-4ce9d0761184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1712854360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6266a124-ea88-4250-bb09-67e450d80a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688535e64c034d51949d530b4646b39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:26Z,use_quota=True,user_id='61c2e81888f84f5aa94875e41bb482d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed067e0-050c-49c1-8cd0-98c8f193c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed067e0-050c-49c1-8cd0-98c8f193c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f7c30-3dc2-4598-957a-b6a1778c09b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f7c30-3dc2-4598-957a-b6a1778c09b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6266a124-ea88-4250-bb09-67e450d80a78', 'volume_name': 'volume-6266a124-ea88-4250-bb09-67e450d80a78', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c52e95-043c-48ad-bdec-e80847adc2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c52e95-043c-48ad-bdec-e80847adc2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c18b6e-a9a1-4438-809d-2a5cb40e2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Volume 6266a124-ea88-4250-bb09-67e450d80a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6266a124-ea88-4250-bb09-67e450d80a78', 'volume_size': 1} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1712854360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6266a124-ea88-4250-bb09-67e450d80a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='688535e64c034d51949d530b4646b39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:26Z,use_quota=True,user_id='61c2e81888f84f5aa94875e41bb482d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Creating volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:25 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1bc8f41a-3d33-4758-a48c-31085ff5c4a6 tempest-GroupSnapshotsTest-1440644260 None] Update group completed successfully. Jul 08 11:18:26 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 1073741824 Jul 08 11:18:26 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Flow 'volume_create_manager' (778e82c7-762e-4504-addd-02189fe12d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c97ad48-e528-4e78-8d00-0e685eda0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c97ad48-e528-4e78-8d00-0e685eda0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1807511662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c49866-32a6-480f-831d-28866e640b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55da37d6017425f9d8e82d4d60763bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:27Z,use_quota=True,user_id='122a7487362f4fd5ad146301bbfe44a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35f8e829-00d4-4009-9d0c-54e3eb7cc985),volume_type_id=35f8e829-00d4-4009-9d0c-54e3eb7cc985)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb71a87-90c7-4aeb-b694-e064ca55ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb71a87-90c7-4aeb-b694-e064ca55ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9f506d-de38-453c-983a-df054a680b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9f506d-de38-453c-983a-df054a680b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c49866-32a6-480f-831d-28866e640b0b', 'volume_name': 'volume-e5c49866-32a6-480f-831d-28866e640b0b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a4e29e-7981-4202-b15d-18ac4fc0fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a4e29e-7981-4202-b15d-18ac4fc0fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0bf1a-f852-4f09-8abf-5192f9a57e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:26 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Volume e5c49866-32a6-480f-831d-28866e640b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c49866-32a6-480f-831d-28866e640b0b', 'volume_size': 1} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:26 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 1073741824" returned: 0 in 0.938s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:26 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 Jul 08 11:18:26 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] GroupSnapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: creating. Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Group snapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: creating. {{(pid=86852) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:27 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78" returned: 0 in 0.652s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1807511662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c49866-32a6-480f-831d-28866e640b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55da37d6017425f9d8e82d4d60763bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:27Z,use_quota=True,user_id='122a7487362f4fd5ad146301bbfe44a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35f8e829-00d4-4009-9d0c-54e3eb7cc985),volume_type_id=35f8e829-00d4-4009-9d0c-54e3eb7cc985)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Creating volume e5c49866-32a6-480f-831d-28866e640b0b {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:27 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c18b6e-a9a1-4438-809d-2a5cb40e2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6266a124-ea88-4250-bb09-67e450d80a78', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9587b980-a340-4e7f-8e3f-3f0b6087fc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:27 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b 1073741824 Jul 08 11:18:27 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:27 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Volume volume-6266a124-ea88-4250-bb09-67e450d80a78 (6266a124-ea88-4250-bb09-67e450d80a78): created successfully Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9587b980-a340-4e7f-8e3f-3f0b6087fc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Flow 'volume_create_manager' (528e3c0d-4ccb-4ad4-a2e4-f85becf82746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e66790de-2825-47ed-9639-2d8b845b5d82 tempest-VolumesSnapshotListTestJSON-1479989428 None] Created volume successfully. Jul 08 11:18:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:28 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b 1073741824" returned: 0 in 0.832s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:28 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b Jul 08 11:18:28 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:29 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b" returned: 0 in 0.637s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.784s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Creating offline snapshot 97b1c94e-e620-4a05-9c00-0971892f394c of volume 9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0bf1a-f852-4f09-8abf-5192f9a57e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c49866-32a6-480f-831d-28866e640b0b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a6396c-4434-4782-8eae-2bf569757b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdf227-f113-4542-8678-1dcb84bed9c4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Volume volume-e5c49866-32a6-480f-831d-28866e640b0b (e5c49866-32a6-480f-831d-28866e640b0b): created successfully Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a6396c-4434-4782-8eae-2bf569757b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Flow 'volume_create_manager' (778e82c7-762e-4504-addd-02189fe12d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fbb5292c-27ab-45ac-8843-d2170cb0485f tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Created volume successfully. Jul 08 11:18:29 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b Jul 08 11:18:29 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:29 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b" returned: 0 in 0.788s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:29 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c 1G Jul 08 11:18:29 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:30 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:30 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Flow 'volume_create_manager' (22c0273d-a288-46ec-a46b-fd79b7c26b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244bb70-7ef3-41ec-8203-8b1dcbebf29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244bb70-7ef3-41ec-8203-8b1dcbebf29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1481405358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf66835-6f51-4a89-9d9b-7389d085a200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5c1ca367074553bfc14f1fadccc27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:30Z,use_quota=True,user_id='41ca3bbadbee422494eaf86ddbc0e126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58127d25-06c6-426d-8516-51a2137403d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58127d25-06c6-426d-8516-51a2137403d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac7a715-213a-49a5-a9a6-1c8e65d86836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac7a715-213a-49a5-a9a6-1c8e65d86836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf66835-6f51-4a89-9d9b-7389d085a200', 'volume_name': 'volume-5bf66835-6f51-4a89-9d9b-7389d085a200', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e486273e-729d-4797-a1fd-9344bb2670fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e486273e-729d-4797-a1fd-9344bb2670fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4280c59-c47d-4590-b359-48fc45bf864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:30 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Volume 5bf66835-6f51-4a89-9d9b-7389d085a200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf66835-6f51-4a89-9d9b-7389d085a200', 'volume_size': 1} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:30 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c 1G" returned: 0 in 0.839s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9121c4c9-68c9-41e9-96bc-027a56edb04b -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:30 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9121c4c9-68c9-41e9-96bc-027a56edb04b -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c Jul 08 11:18:30 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:31 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0f917e14-d751-487b-aaf1-5cb7a28b53b6 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Retype volume completed successfully. Jul 08 11:18:31 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9121c4c9-68c9-41e9-96bc-027a56edb04b -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c" returned: 0 in 0.702s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:31 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:31 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c Jul 08 11:18:31 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "cinder-e5c49866-32a6-480f-831d-28866e640b0b-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "cinder-e5c49866-32a6-480f-831d-28866e640b0b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "cinder-quobyte-e5c49866-32a6-480f-831d-28866e640b0b" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "cinder-quobyte-e5c49866-32a6-480f-831d-28866e640b0b" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cdbac6-6a0e-440f-bb28-ef438b38e0dd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:31 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b Jul 08 11:18:31 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:32 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c" returned: 0 in 0.662s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:32 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info Jul 08 11:18:32 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:32 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b" returned: 0 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:32 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b Jul 08 11:18:32 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:32 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info" returned: 0 in 0.673s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:32 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:18:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:32 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info Jul 08 11:18:32 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:33 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c49866-32a6-480f-831d-28866e640b0b" returned: 0 in 0.668s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "cinder-quobyte-e5c49866-32a6-480f-831d-28866e640b0b" released by "delete_volume" :: held 1.465s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:33 devstack cinder-volume[86852]: WARNING cinder.quota [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:33 devstack cinder-volume[86852]: WARNING cinder.quota [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Created reservations ['01374311-c403-463d-b22a-f39ba4c81caa', '26e73feb-a1b5-453d-96dc-a334e9325218', '80908f1a-002b-47d8-af7a-6f1a3b3eac97', '948ff344-9190-4b84-9a05-494f4d8b4259'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:33 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:33 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:33 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.info" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.380s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Creating offline snapshot b0af0ddd-e043-4609-b47f-fce04ae412bd of volume 34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da176a-8067-48a8-8083-9908e23754a6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:33 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea Jul 08 11:18:33 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:33 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Deleted volume successfully. Jul 08 11:18:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-128de289-6065-4119-a684-7af6f115a432 tempest-VolumeRetypeWithoutMigrationTest-763713934 None] Lock "cinder-e5c49866-32a6-480f-831d-28866e640b0b-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:34 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" returned: 0 in 0.812s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:34 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd 1G Jul 08 11:18:34 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:35 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd 1G" returned: 0 in 0.840s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:35 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd Jul 08 11:18:35 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:35 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd" returned: 0 in 0.730s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:35 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:18:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:35 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd Jul 08 11:18:35 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:36 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd" returned: 0 in 0.680s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:36 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info Jul 08 11:18:36 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:37 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:37 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:18:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:37 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info Jul 08 11:18:37 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:37 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.info" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.388s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1481405358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf66835-6f51-4a89-9d9b-7389d085a200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5c1ca367074553bfc14f1fadccc27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:30Z,use_quota=True,user_id='41ca3bbadbee422494eaf86ddbc0e126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Creating volume 5bf66835-6f51-4a89-9d9b-7389d085a200 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:38 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:38 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 1073741824 Jul 08 11:18:38 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-89bb81c3-906c-4996-80b1-7c565dfcc080 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: created successfully Jul 08 11:18:38 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 1073741824" returned: 0 in 0.850s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:38 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 Jul 08 11:18:38 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] group_snapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: deleting Jul 08 11:18:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] group_snapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: deleting {{(pid=86852) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Flow 'volume_create_manager' (2eab0e96-0ad5-400a-8d4a-db88346c8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891183c0-0538-4e9b-b5b2-2e05914fb60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-97b1c94e-e620-4a05-9c00-0971892f394c" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891183c0-0538-4e9b-b5b2-2e05914fb60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-932276191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67b81eb-6dcd-420f-a2c5-5eff24346e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb546c28cd64564b6c0bd5deb8697d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:39Z,use_quota=True,user_id='72c8867fb7994e0f8f34f7f6322c3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03432390-1243-47f8-bdad-98adb19cb3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03432390-1243-47f8-bdad-98adb19cb3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2fdce1-9c49-4ec7-8921-f0a506eae00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2fdce1-9c49-4ec7-8921-f0a506eae00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67b81eb-6dcd-420f-a2c5-5eff24346e00', 'volume_name': 'volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40a29bf-4e4a-4e04-a27c-f38b473e75d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40a29bf-4e4a-4e04-a27c-f38b473e75d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddace92-2bce-4990-acaa-056abb493ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Volume b67b81eb-6dcd-420f-a2c5-5eff24346e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00', 'volume_size': 1} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-97b1c94e-e620-4a05-9c00-0971892f394c" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Deleting offline snapshot 97b1c94e-e620-4a05-9c00-0971892f394c of volume 9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] snapshot_file for this snap is: volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23259a-14ec-4444-b847-bc3fac43a874]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:39 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c Jul 08 11:18:39 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:39 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200" returned: 0 in 0.700s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.496s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Creating offline snapshot ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4280c59-c47d-4590-b359-48fc45bf864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf66835-6f51-4a89-9d9b-7389d085a200', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2334ce29-b14b-4813-be16-360424c56c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cbda27-935a-4094-8f9e-cc00e16d23ac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Volume volume-5bf66835-6f51-4a89-9d9b-7389d085a200 (5bf66835-6f51-4a89-9d9b-7389d085a200): created successfully Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2334ce29-b14b-4813-be16-360424c56c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Flow 'volume_create_manager' (22c0273d-a288-46ec-a46b-fd79b7c26b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:39 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b41b1408-0477-4ea3-bad4-538606fa7e7c tempest-AttachVolumeShelveTestJSON-256098382 None] Created volume successfully. Jul 08 11:18:39 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 Jul 08 11:18:39 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:40 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9121c4c9-68c9-41e9-96bc-027a56edb04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff9ded-898b-40c6-b432-0172985350a7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:40 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b Jul 08 11:18:40 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:40 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:40 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 1G Jul 08 11:18:40 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:40 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b" returned: 0 in 0.835s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:40 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c Jul 08 11:18:40 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:41 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 1G" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:41 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:18:41 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:41 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:41 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c Jul 08 11:18:41 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:42 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:42 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 is being set with open permissions: ugo+rw Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:42 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:18:42 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:42 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b.97b1c94e-e620-4a05-9c00-0971892f394c" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-97b1c94e-e620-4a05-9c00-0971892f394c" released by "_delete_snapshot" :: held 3.245s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" released by "delete_snapshot" :: held 3.317s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-b0af0ddd-e043-4609-b47f-fce04ae412bd" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-b0af0ddd-e043-4609-b47f-fce04ae412bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Deleting offline snapshot b0af0ddd-e043-4609-b47f-fce04ae412bd of volume 34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] snapshot_file for this snap is: volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[45297df1-b6fb-4f5f-8006-b5f2074b2e07]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:42 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd Jul 08 11:18:42 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:42 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:42 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info Jul 08 11:18:42 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:43 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2e218-759e-44b2-adca-4ce0d356ad86]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:43 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea Jul 08 11:18:43 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:43 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info" returned: 0 in 0.669s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:43 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info is being set with open permissions: ugo+rw Jul 08 11:18:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:43 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info Jul 08 11:18:43 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:44 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:44 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd Jul 08 11:18:44 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:44 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.info" returned: 0 in 0.706s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.023s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-932276191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67b81eb-6dcd-420f-a2c5-5eff24346e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb546c28cd64564b6c0bd5deb8697d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:39Z,use_quota=True,user_id='72c8867fb7994e0f8f34f7f6322c3e77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Creating volume b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:44 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:44 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 1073741824 Jul 08 11:18:44 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f7f06514-8dd4-456c-891b-2afc5253fe00 tempest-VolumesSnapshotListTestJSON-1479989428 None] Create snapshot completed successfully Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:44 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd" returned: 0 in 0.827s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:44 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd Jul 08 11:18:44 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:45 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 1073741824" returned: 0 in 0.975s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:45 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 Jul 08 11:18:45 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:45 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea.b0af0ddd-e043-4609-b47f-fce04ae412bd" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-b0af0ddd-e043-4609-b47f-fce04ae412bd" released by "_delete_snapshot" :: held 3.253s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" released by "delete_snapshot" :: held 3.276s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:45 devstack cinder-volume[86852]: WARNING cinder.quota [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1497456065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1497456065, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:45 devstack cinder-volume[86852]: WARNING cinder.quota [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1497456065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1497456065, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['085d7376-3d58-44ff-90fd-f3a3e0c8751e', '7f582a87-fcdc-4757-a540-2eea0e77081d', '85f9052e-cf3c-4b15-bb8c-07cb8e2aadde', '137a250b-0baf-4542-bba9-e11f34e2df63'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:45 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00" returned: 0 in 0.661s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.969s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['5f9591a7-5d5f-4a12-b127-9b406b78e214', '2d00ddc6-aa75-4dba-9f21-8360474516ce', '5c0c1422-feea-4660-a610-c60f6519816b', '9ccb21f3-a23b-4c2b-9130-e15f7a40340b'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddace92-2bce-4990-acaa-056abb493ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0ccac-9ba0-4b6a-a10c-18ea6a4fb381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Creating offline snapshot 5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Volume volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 (b67b81eb-6dcd-420f-a2c5-5eff24346e00): created successfully Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0ccac-9ba0-4b6a-a10c-18ea6a4fb381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Flow 'volume_create_manager' (2eab0e96-0ad5-400a-8d4a-db88346c8adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc55c4-2044-42ef-b217-87f249cdfa12]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bb4244be-f285-4043-b957-137a6a41a196 tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Created volume successfully. Jul 08 11:18:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ffbdec0e-3535-4f3f-a715-6a66361685ee tempest-GroupSnapshotsTest-1440644260 None] group_snapshot d7aa69ed-67db-428e-82fa-cf892bfca39a: deleted successfully Jul 08 11:18:46 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:18:46 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=117,cinder:UPDATE=118,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=110,cinder:UPDATE=112,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:18:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:47 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.956s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:47 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 1G Jul 08 11:18:47 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e08ff-40e8-469d-915e-da4246237194]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:47 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea Jul 08 11:18:47 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:47 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 1G" returned: 0 in 0.905s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:47 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:18:47 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:48 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" returned: 0 in 0.947s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:48 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea Jul 08 11:18:48 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:48 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 0.750s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:48 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 is being set with open permissions: ugo+rw Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:48 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:18:48 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:48 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-34c546f5-b0d8-431e-a0ec-058b0a0b3dea" released by "delete_volume" :: held 1.733s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[565169b5-30da-4c0d-9f02-7cd76f20d86e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:49 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b Jul 08 11:18:49 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:49 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 0.718s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.686s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Creating offline snapshot 1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b of volume b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3f19787a-9226-4c4e-bf1b-49f09c0ead51 tempest-VolumesSnapshotListTestJSON-1479989428 None] Create snapshot completed successfully Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3970f73-da91-461a-9fd5-67e481e75c7e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:49 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 Jul 08 11:18:49 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:49 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b" returned: 0 in 0.819s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:49 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b Jul 08 11:18:49 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:50 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:50 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b 1G Jul 08 11:18:50 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:50 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9121c4c9-68c9-41e9-96bc-027a56edb04b" returned: 0 in 0.698s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-9121c4c9-68c9-41e9-96bc-027a56edb04b" released by "delete_volume" :: held 1.595s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['b0813f8a-24c3-4ec2-aef0-8b91ac3743f4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:50 devstack cinder-volume[86852]: WARNING cinder.quota [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1497456065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1497456065, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['67aba20b-d05e-486d-88d1-20a2ab0f92a3', '861a0177-c4b6-42d0-be61-80922893aee0', '1ea15be7-281d-4c67-8fab-c7883e36a334', 'bbfc31e2-0461-4c7f-9239-53dad6851afc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['56f9a90c-082f-4bb9-9d52-412f29dcc9b8', '1891ee17-49b3-495c-9158-713734b0a64a', 'db5700a6-978b-4647-bfc0-b198a8382f43', 'f216d25c-2281-4724-b74c-639eb7c1c2a9'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:50 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:50 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:51 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b 1G" returned: 0 in 0.998s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:51 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b Jul 08 11:18:51 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0e04bf66-7436-44a3-80cb-7bfd0aa8274f tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-465707958: creating Jul 08 11:18:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0e04bf66-7436-44a3-80cb-7bfd0aa8274f tempest-GroupSnapshotsTest-1440644260 None] Group tempest-GroupSnapshotsTest-Group-465707958: created successfully Jul 08 11:18:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0e04bf66-7436-44a3-80cb-7bfd0aa8274f tempest-GroupSnapshotsTest-1440644260 None] Create group completed successfully. Jul 08 11:18:51 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:51 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dbc11166-56e5-4eb2-a469-60fca0e1c086 tempest-GroupSnapshotsTest-1440644260 None] Delete group completed successfully. Jul 08 11:18:52 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:52 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b is being set with open permissions: ugo+rw Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:52 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b Jul 08 11:18:52 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:52 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:18:52 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:52 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" returned: 0 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:52 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info Jul 08 11:18:52 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:53 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.755s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (0f174b37-c5ae-4346-b49b-529060123b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee3c42-23f6-42d7-bcca-7f894a5b70ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee3c42-23f6-42d7-bcca-7f894a5b70ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340666806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38ed23f8-3979-4b48-a648-a1b4ec9255bd,host='devstack@QuobyteHD#QuobyteHD',id=640ad052-8f7b-42df-a991-d3b56fa1b054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:53Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a74071-9cfa-416f-8018-036564deb7c7),volume_type_id=a7a74071-9cfa-416f-8018-036564deb7c7)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237752c2-d8c0-41b8-a681-93f8cf5d274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237752c2-d8c0-41b8-a681-93f8cf5d274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5c37e-68ad-4d20-80f7-04c03c13c49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5c37e-68ad-4d20-80f7-04c03c13c49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640ad052-8f7b-42df-a991-d3b56fa1b054', 'volume_name': 'volume-640ad052-8f7b-42df-a991-d3b56fa1b054', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e1418-729f-47dc-8cb5-3494ea048df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52e1418-729f-47dc-8cb5-3494ea048df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fcff56-f0bc-4536-a3fb-9839b73bd52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:53 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Volume 640ad052-8f7b-42df-a991-d3b56fa1b054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640ad052-8f7b-42df-a991-d3b56fa1b054', 'volume_size': 1} Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:53 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info" returned: 0 in 0.924s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:53 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info is being set with open permissions: ugo+rw Jul 08 11:18:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:53 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info Jul 08 11:18:53 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:54 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.info" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.982s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Creating offline snapshot 38b917f9-b693-438c-9d5a-9f04587dc5e9 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ccbc8d-c016-4354-a36b-2765c39c99da]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a1772904-7bb8-459c-9cdb-dd73608b9f7c tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Create snapshot completed successfully Jul 08 11:18:54 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:18:54 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:55 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 0.864s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:55 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 1G Jul 08 11:18:55 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-f1e621b4-7d95-449c-9787-0326bb50adb3 req-35b77664-b0c1-4bae-98ce-05a9850750f0 tempest-AttachVolumeShelveTestJSON-256098382 None] No connector for attachment 607623e0-90be-46a7-bb68-8c282396932e; skipping storage backend terminate_connection call. {{(pid=86852) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-f1e621b4-7d95-449c-9787-0326bb50adb3 req-35b77664-b0c1-4bae-98ce-05a9850750f0 tempest-AttachVolumeShelveTestJSON-256098382 None] Deleting attachment 607623e0-90be-46a7-bb68-8c282396932e. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "cinder-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "cinder-quobyte-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Deleting offline snapshot 1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b of volume b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] snapshot_file for this snap is: volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a667ace-92e9-4c66-af8f-f645661d4915]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:56 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b Jul 08 11:18:56 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:56 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 1G" returned: 0 in 0.912s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:56 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 Jul 08 11:18:56 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:56 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" returned: 0 in 0.788s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7222bfc3-42bb-44ad-8cc4-7b9521bfe095]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:56 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 Jul 08 11:18:56 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:57 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9" returned: 0 in 0.854s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:57 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 is being set with open permissions: ugo+rw Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:57 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 Jul 08 11:18:57 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:57 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:57 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b Jul 08 11:18:57 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:57 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9" returned: 0 in 0.676s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.435s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.470s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38ed23f8-3979-4b48-a648-a1b4ec9255bd,created_at=2026-07-08T09:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340666806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38ed23f8-3979-4b48-a648-a1b4ec9255bd,host='devstack@QuobyteHD#QuobyteHD',id=640ad052-8f7b-42df-a991-d3b56fa1b054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3326858346d4ec28c8fee3d755a61fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:18:53Z,use_quota=True,user_id='1f2ddb2a390248d09adf2f0ae8bfdc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a74071-9cfa-416f-8018-036564deb7c7),volume_type_id=a7a74071-9cfa-416f-8018-036564deb7c7)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Creating volume 640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:18:57 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:18:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-13919ddc-b999-4f20-9c4a-6b3fe4b98021 tempest-VolumesSnapshotListTestJSON-1479989428 None] Create snapshot completed successfully Jul 08 11:18:57 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 1073741824 Jul 08 11:18:57 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:58 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" returned: 0 in 0.772s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:58 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b Jul 08 11:18:58 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:58 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 1073741824" returned: 0 in 0.881s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:58 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 Jul 08 11:18:58 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:18:59 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00.1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b" released by "_delete_snapshot" :: held 3.188s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" released by "delete_snapshot" :: held 3.217s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Created reservations ['61589cc3-6f53-4672-911e-926e0477d460', 'e42b5de9-e546-4d4d-974b-1a0255b326df', 'bc809788-0bbf-4c5c-80d9-c19f7febc3d7', '31d35d4f-1101-4783-bd8e-77657727fd16'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:18:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Delete snapshot completed successfully. Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-6e8c056c-2354-42ce-a4f3-b624bb9ba5ed tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-1c45ef5a-e4a5-4565-8359-ea5bf7fdd92b-delete_snapshot" released by "delete_snapshot" :: held 3.400s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:18:59 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054" returned: 0 in 0.795s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fcff56-f0bc-4536-a3fb-9839b73bd52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640ad052-8f7b-42df-a991-d3b56fa1b054', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1ea646-b8bd-4a88-84dc-c68ec9b7fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:18:59 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Volume volume-640ad052-8f7b-42df-a991-d3b56fa1b054 (640ad052-8f7b-42df-a991-d3b56fa1b054): created successfully Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1ea646-b8bd-4a88-84dc-c68ec9b7fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Flow 'volume_create_manager' (0f174b37-c5ae-4346-b49b-529060123b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:18:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4764d162-d0a6-4121-bf4f-9cbd4dc9f5ac tempest-GroupSnapshotsTest-1440644260 None] Created volume successfully. Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-38b917f9-b693-438c-9d5a-9f04587dc5e9-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-38b917f9-b693-438c-9d5a-9f04587dc5e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-38b917f9-b693-438c-9d5a-9f04587dc5e9" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-38b917f9-b693-438c-9d5a-9f04587dc5e9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Deleting offline snapshot 38b917f9-b693-438c-9d5a-9f04587dc5e9 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] snapshot_file for this snap is: volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bafbc09-1fba-4393-8f82-a28fd46beb7a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:18:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:18:59 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 Jul 08 11:18:59 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "cinder-b67b81eb-6dcd-420f-a2c5-5eff24346e00-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-b67b81eb-6dcd-420f-a2c5-5eff24346e00-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4df461-0450-4032-919b-27483d624826]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:00 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 Jul 08 11:19:00 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:00 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9" returned: 0 in 0.820s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] GroupSnapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: creating. Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd45e65-8525-4424-b1db-11aa0e217560]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Group snapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: creating. {{(pid=86852) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Creating offline snapshot 15098b76-cb89-4498-a01f-74114a3c8a51 of volume 640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d9716-f046-49b9-943e-507a0e334588]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:00 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:19:00 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:00 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 Jul 08 11:19:00 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:01 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00" returned: 0 in 0.927s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:01 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00 Jul 08 11:19:01 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:01 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 0.879s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:01 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054" returned: 0 in 0.831s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:01 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 Jul 08 11:19:01 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:01 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 1G Jul 08 11:19:01 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:01 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b67b81eb-6dcd-420f-a2c5-5eff24346e00" returned: 0 in 0.756s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-quobyte-b67b81eb-6dcd-420f-a2c5-5eff24346e00" released by "delete_volume" :: held 1.749s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Created reservations ['3ba9751c-bbf3-423c-af37-b140a2e2386a', 'f203cb4a-f3bd-4eae-9bcc-b0252af39360', 'f54f9559-8d02-48ae-8aba-c5c4530ece53', '90998208-9f50-4b3d-ba6e-ded2ab533a58'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:02 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:02 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:02 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9" returned: 0 in 0.846s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:02 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9 Jul 08 11:19:02 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:02 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 1G" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640ad052-8f7b-42df-a991-d3b56fa1b054 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:02 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640ad052-8f7b-42df-a991-d3b56fa1b054 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 Jul 08 11:19:02 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:03 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.855s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Deleted volume successfully. Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-407254f2-e40f-4183-8a6a-db5935e48ada tempest-VolumeSnapshotQuotasNegativeTestJSON-720224278 None] Lock "cinder-b67b81eb-6dcd-420f-a2c5-5eff24346e00-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:03 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.38b917f9-b693-438c-9d5a-9f04587dc5e9" returned: 0 in 1.012s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-38b917f9-b693-438c-9d5a-9f04587dc5e9" released by "_delete_snapshot" :: held 3.689s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" released by "delete_snapshot" :: held 3.713s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Created reservations ['b2a3d8fd-4735-4cfb-8084-74a7bd0deadf', '2c423310-c930-48b5-abbe-4544cf5e1184', '24bea043-2ef9-4c1e-9a59-687aa653f844', '1cd15b79-9db2-4666-bfed-a79d949f053d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:03 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640ad052-8f7b-42df-a991-d3b56fa1b054 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51" returned: 0 in 0.986s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:03 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:03 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 Jul 08 11:19:03 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Delete snapshot completed successfully. Jul 08 11:19:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4913a69e-1cec-4daf-ba00-fbb4f10876fe tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-38b917f9-b693-438c-9d5a-9f04587dc5e9-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Deleting offline snapshot 5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] snapshot_file for this snap is: volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[019108db-d177-41d2-b334-a2a7599e06c4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:04 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:19:04 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:04 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51" returned: 0 in 0.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:04 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info Jul 08 11:19:04 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:05 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 1.015s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c4fded-492e-4920-8985-f99b8f67f5fd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:05 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info" returned: 0 in 0.816s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:05 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:19:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:05 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info Jul 08 11:19:05 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:05 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:19:05 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:06 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.info" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.278s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:06 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.866s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:06 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:19:06 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1b9a02d8-bc43-456e-8ada-c733e9af61e8 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: created successfully Jul 08 11:19:07 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 1.199s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:07 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3 Jul 08 11:19:07 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: deleting Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: deleting {{(pid=86852) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-15098b76-cb89-4498-a01f-74114a3c8a51" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-15098b76-cb89-4498-a01f-74114a3c8a51" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Deleting offline snapshot 15098b76-cb89-4498-a01f-74114a3c8a51 of volume 640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] snapshot_file for this snap is: volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7485d6d-6df7-42d4-a287-afe82c97b3ea]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:07 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 Jul 08 11:19:07 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:08 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" returned: 0 in 0.870s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3" released by "_delete_snapshot" :: held 4.099s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" released by "delete_snapshot" :: held 4.130s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Created reservations ['17c61fdf-46f8-4714-9a9a-c7c74cce1480', '47238f99-dfdd-4a11-8f0e-6b072eb8cf28', '697ea554-5671-449b-b2c7-871c757184c0', 'fef9d8f1-cd02-42d4-8a73-15a7280f7603'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Delete snapshot completed successfully. Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3ec8a55a-afac-40ad-ae33-e2d6ce78ba95 tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-5a5cf5a5-bb21-481b-adc6-3fa4062c66c3-delete_snapshot" released by "delete_snapshot" :: held 4.421s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:08 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51" returned: 0 in 1.076s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640ad052-8f7b-42df-a991-d3b56fa1b054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642a070-f904-421b-bb3f-87465def3596]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:08 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 Jul 08 11:19:08 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Deleting offline snapshot ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 of volume 6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] snapshot_file for this snap is: volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b51825-13d3-4624-bf91-c2723c2e65d6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:09 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054" returned: 0 in 0.930s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:09 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:19:09 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:09 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 Jul 08 11:19:09 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:10 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.846s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6266a124-ea88-4250-bb09-67e450d80a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ef857-92c8-41e7-af70-fd237f8e7c80]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:10 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51" returned: 0 in 0.904s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:10 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51 Jul 08 11:19:10 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:10 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 Jul 08 11:19:10 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:11 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78" returned: 0 in 0.903s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:11 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:19:11 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:11 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054.15098b76-cb89-4498-a01f-74114a3c8a51" returned: 0 in 0.891s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-15098b76-cb89-4498-a01f-74114a3c8a51" released by "_delete_snapshot" :: held 3.952s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" released by "delete_snapshot" :: held 4.011s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:11 devstack cinder-volume[86852]: WARNING cinder.quota [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-995294356 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-995294356, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:19:11 devstack cinder-volume[86852]: WARNING cinder.quota [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-995294356 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-995294356, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:19:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['b7afc7d9-39ac-4aa5-8168-489e97809fad', 'aa849c7b-9f86-484f-8511-8431a4999b5f', '67c2a3fd-6eaf-4920-a5af-4ae0da4c1baf', '570b1f0f-4ae2-4c15-a7ec-18d3a8b2a376'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-da7260f8-f045-4aa6-9053-2d48e6ffc1e8 tempest-GroupSnapshotsTest-1440644260 None] group_snapshot 1d96625b-1832-4bd8-8d53-baa602e0353d: deleted successfully Jul 08 11:19:12 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 1.002s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:12 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297 Jul 08 11:19:12 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec9f1a-5de5-4089-be7a-b827a578c7c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:12 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 Jul 08 11:19:12 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:13 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78.ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" returned: 0 in 0.841s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297" released by "_delete_snapshot" :: held 3.728s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" released by "delete_snapshot" :: held 3.763s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Created reservations ['b71e24c9-a1af-456e-bbfc-9d73102b7615', 'f02f908e-ba88-4ec7-ac45-d388be3caa0d', 'b878bb91-3bba-439d-813f-97a0c4770bf8', '8290ed39-910a-4627-99be-abe226a3f942'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Delete snapshot completed successfully. Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26ab82aa-2d6c-4a0a-ad6f-1c19815400ed tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-ad25cb78-5f49-4de1-ac9e-e4ca1f0da297-delete_snapshot" released by "delete_snapshot" :: held 3.928s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:13 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054" returned: 0 in 1.213s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:13 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054 Jul 08 11:19:13 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-6266a124-ea88-4250-bb09-67e450d80a78-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-6266a124-ea88-4250-bb09-67e450d80a78-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e5679-81e6-4527-8668-241e05ccea4d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:14 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 Jul 08 11:19:14 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:14 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-640ad052-8f7b-42df-a991-d3b56fa1b054" returned: 0 in 1.075s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Lock "cinder-quobyte-640ad052-8f7b-42df-a991-d3b56fa1b054" released by "delete_volume" :: held 2.357s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['dc0d8d86-493f-4994-b467-e51c4c44121e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:15 devstack cinder-volume[86852]: WARNING cinder.quota [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-995294356 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-995294356, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Created reservations ['5c811ab0-1a04-44aa-9c84-d680bf9b925b', '413fb9b8-fc77-445b-9eb3-302bfd198224', 'eea14e30-1257-4efc-bc62-78b2faec6d72', '176f6796-114d-4d1e-84b7-d42001ac9bed'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:15 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78" returned: 0 in 1.158s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:15 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:15 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:15 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78 Jul 08 11:19:15 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:16 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6266a124-ea88-4250-bb09-67e450d80a78" returned: 0 in 0.983s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-quobyte-6266a124-ea88-4250-bb09-67e450d80a78" released by "delete_volume" :: held 2.298s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Created reservations ['b843b387-da48-4de7-a90c-1487fc188bb1', 'a33847e5-3abd-4822-b47c-3408ef4435c0', '25908ff8-b678-4d82-94c0-4264372158d5', '164fcf60-ab96-4f90-b830-36c6c59f3785'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:16 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:16 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:16 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.659s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:16 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d0b912a7-9fae-4c1d-b030-0ef9a9d19d91 tempest-GroupSnapshotsTest-1440644260 None] Delete group completed successfully. Jul 08 11:19:18 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.596s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:18 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Deleted volume successfully. Jul 08 11:19:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9597d4eb-568c-4ea6-9113-fa889fa4b5ad tempest-VolumesSnapshotListTestJSON-1479989428 None] Lock "cinder-6266a124-ea88-4250-bb09-67e450d80a78-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-eb5a9dee-cde9-4da4-baf6-6944810110f6 tempest-GroupsV320Test-402603251 None] Group tempest-GroupsV320Test-Group-1763501990: creating Jul 08 11:19:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-eb5a9dee-cde9-4da4-baf6-6944810110f6 tempest-GroupsV320Test-402603251 None] Group tempest-GroupsV320Test-Group-1763501990: created successfully Jul 08 11:19:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-eb5a9dee-cde9-4da4-baf6-6944810110f6 tempest-GroupsV320Test-402603251 None] Create group completed successfully. Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Created reservations ['577c25ec-af82-4e7e-bf16-8865bb75dd1e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:27 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:27 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:28 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.948s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:28 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f4c4002e-dfb1-4c56-a00e-f86bdda25f9c tempest-GroupsV320Test-402603251 None] Delete group completed successfully. Jul 08 11:19:37 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=80,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:19:37 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=84,cinder:DELETE=2,cinder:UPDATE=95,cinder:INSERT=30 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Acquiring lock "cinder-5bf66835-6f51-4a89-9d9b-7389d085a200-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "cinder-5bf66835-6f51-4a89-9d9b-7389d085a200-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Acquiring lock "cinder-quobyte-5bf66835-6f51-4a89-9d9b-7389d085a200" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "cinder-quobyte-5bf66835-6f51-4a89-9d9b-7389d085a200" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee7629-3131-4087-9fd6-35b7e2275c1d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:19:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:48 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 Jul 08 11:19:48 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:49 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200" returned: 0 in 0.846s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:49 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200 Jul 08 11:19:49 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:50 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bf66835-6f51-4a89-9d9b-7389d085a200" returned: 0 in 0.976s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "cinder-quobyte-5bf66835-6f51-4a89-9d9b-7389d085a200" released by "delete_volume" :: held 1.908s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Created reservations ['3923cb61-0a55-4cc6-a4f3-c7506ac29858', '4a71a71f-a628-4941-b9fc-899794bf5faf', '03be0ece-ed00-400d-911c-36f6dff63c02', '8bfa5f3e-a6f8-4782-8184-176b815bacaa'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:50 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:50 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:51 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.893s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:51 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Deleted volume successfully. Jul 08 11:19:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3b40f95b-1aa4-495e-b9ce-06f699250ca3 tempest-AttachVolumeShelveTestJSON-256098382 None] Lock "cinder-5bf66835-6f51-4a89-9d9b-7389d085a200-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:52 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:19:52 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:53 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.344s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:19:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:19:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:19:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (bb49e847-77ee-4923-a5c8-53aacedef9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4007df-3570-4a41-a006-e5d1c03bd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4007df-3570-4a41-a006-e5d1c03bd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089597019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10a209-55cf-471d-b6f4-4e1ab8263879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:19:57Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446d0aef-2ae0-4169-939b-37073bf2a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446d0aef-2ae0-4169-939b-37073bf2a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf584c6b-ae13-4817-8342-970c47fc3c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf584c6b-ae13-4817-8342-970c47fc3c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b10a209-55cf-471d-b6f4-4e1ab8263879', 'volume_name': 'volume-9b10a209-55cf-471d-b6f4-4e1ab8263879', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b58271d-895a-49f9-a8c6-38bddeedbff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b58271d-895a-49f9-a8c6-38bddeedbff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3985838-65af-469a-adc4-5e64566b88a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:19:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Volume 9b10a209-55cf-471d-b6f4-4e1ab8263879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b10a209-55cf-471d-b6f4-4e1ab8263879', 'volume_size': 1} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089597019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10a209-55cf-471d-b6f4-4e1ab8263879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:19:57Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Creating volume 9b10a209-55cf-471d-b6f4-4e1ab8263879 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:19:57 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:19:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:57 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 1073741824 Jul 08 11:19:57 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:58 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 1073741824" returned: 0 in 1.803s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:19:59 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 Jul 08 11:19:59 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:19:59 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 08 11:19:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879" returned: 0 in 0.938s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:19:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] <== create_volume: return (2826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:19:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.831s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3985838-65af-469a-adc4-5e64566b88a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b10a209-55cf-471d-b6f4-4e1ab8263879', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e666bf-b704-4ef7-a9e8-7caa82063071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Volume volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 (9b10a209-55cf-471d-b6f4-4e1ab8263879): created successfully Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e666bf-b704-4ef7-a9e8-7caa82063071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (bb49e847-77ee-4923-a5c8-53aacedef9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5082b831-2456-4ad9-bdee-7d7cbbd76180 tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-27446580-4070-4bee-8f07-66614442e17a tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879" by "attach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-27446580-4070-4bee-8f07-66614442e17a tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879" acquired by "attach_volume" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-27446580-4070-4bee-8f07-66614442e17a tempest-VolumesActionsTest-221013301 None] Attaching volume 9b10a209-55cf-471d-b6f4-4e1ab8263879 to instance 8f8a4a76-ecd8-48e7-b677-054dd9ef2789 at mountpoint /dev/vdb on host None. Jul 08 11:20:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-27446580-4070-4bee-8f07-66614442e17a tempest-VolumesActionsTest-221013301 None] Attach volume completed successfully. Jul 08 11:20:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-27446580-4070-4bee-8f07-66614442e17a tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879" released by "attach_volume" :: held 0.208s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Terminate volume connection completed successfully. Jul 08 11:20:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" by "detach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Detaching volume 9b10a209-55cf-471d-b6f4-4e1ab8263879 from instance 8f8a4a76-ecd8-48e7-b677-054dd9ef2789. Jul 08 11:20:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Detach volume completed successfully. Jul 08 11:20:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-21c3b6b2-1e90-4e93-9422-d07fda110f9f tempest-VolumesActionsTest-597653194 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:02 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Flow 'volume_create_manager' (38f1497c-7544-47c0-82ba-3cdbe87afa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f09dd7-d6ea-4a1d-99e5-08c005feb4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f09dd7-d6ea-4a1d-99e5-08c005feb4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1258504702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d1428-335e-4fb1-b205-6b01905b073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2f5f5e85ad47e489396d61ff12c5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:03Z,use_quota=True,user_id='34b6ca5cd7ed4a4f96114b76b7660c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c11ff0-a0ca-4b68-9979-83de0a0ff649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c11ff0-a0ca-4b68-9979-83de0a0ff649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c47c73-34ea-413b-b519-c73ac2b50232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c47c73-34ea-413b-b519-c73ac2b50232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821d1428-335e-4fb1-b205-6b01905b073f', 'volume_name': 'volume-821d1428-335e-4fb1-b205-6b01905b073f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c3f3d9-4c2a-45e8-ae47-d5e1e81188e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c3f3d9-4c2a-45e8-ae47-d5e1e81188e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61974318-ec22-4d06-86c1-51b947aac630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume 821d1428-335e-4fb1-b205-6b01905b073f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821d1428-335e-4fb1-b205-6b01905b073f', 'volume_size': 1} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1258504702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d1428-335e-4fb1-b205-6b01905b073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2f5f5e85ad47e489396d61ff12c5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:03Z,use_quota=True,user_id='34b6ca5cd7ed4a4f96114b76b7660c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Creating volume 821d1428-335e-4fb1-b205-6b01905b073f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:03 devstack sudo[94645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f 1073741824 Jul 08 11:20:03 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ec4d114-e229-4ae3-9953-c090088608aa tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" by "detach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ec4d114-e229-4ae3-9953-c090088608aa tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1ec4d114-e229-4ae3-9953-c090088608aa tempest-VolumesActionsTest-221013301 None] Volume detach called, but volume not attached. Jul 08 11:20:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ec4d114-e229-4ae3-9953-c090088608aa tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-quobyte-9b10a209-55cf-471d-b6f4-4e1ab8263879" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "cinder-quobyte-9b10a209-55cf-471d-b6f4-4e1ab8263879" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[747879fc-6408-486c-a0d8-8aa4b10faf80]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:04 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f 1073741824" returned: 0 in 1.249s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:04 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 Jul 08 11:20:04 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:04 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f Jul 08 11:20:04 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:05 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879" returned: 0 in 1.476s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:05 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879 Jul 08 11:20:05 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:05 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f" returned: 0 in 1.530s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] <== create_volume: return (2837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.844s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61974318-ec22-4d06-86c1-51b947aac630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821d1428-335e-4fb1-b205-6b01905b073f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d571bbd-f9cd-4ec7-88b0-dce904225029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume volume-821d1428-335e-4fb1-b205-6b01905b073f (821d1428-335e-4fb1-b205-6b01905b073f): created successfully Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d571bbd-f9cd-4ec7-88b0-dce904225029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Flow 'volume_create_manager' (38f1497c-7544-47c0-82ba-3cdbe87afa38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-36e44a8d-8afe-467b-a0a5-52135d2d9371 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Created volume successfully. Jul 08 11:20:06 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9b10a209-55cf-471d-b6f4-4e1ab8263879" returned: 0 in 0.917s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "cinder-quobyte-9b10a209-55cf-471d-b6f4-4e1ab8263879" released by "delete_volume" :: held 2.466s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Created reservations ['fd11da6f-b5b0-4889-9973-33c8faf68aac', '451af700-baed-4368-bb22-47c31907e350', '56aca36f-7757-4634-a507-6ed1517a1c9d', 'ee9fd32f-847d-43ca-847c-9d4921eddc46'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:06 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:06 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "cinder-821d1428-335e-4fb1-b205-6b01905b073f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "cinder-821d1428-335e-4fb1-b205-6b01905b073f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "cinder-quobyte-821d1428-335e-4fb1-b205-6b01905b073f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "cinder-quobyte-821d1428-335e-4fb1-b205-6b01905b073f" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa4f16-c418-4506-9bc7-9fe7256556c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:07 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f Jul 08 11:20:07 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:08 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.183s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:08 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Deleted volume successfully. Jul 08 11:20:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09cb83e9-29d6-48b5-b9b9-1bb991d5fb0f tempest-VolumesActionsTest-221013301 None] Lock "cinder-9b10a209-55cf-471d-b6f4-4e1ab8263879-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:08 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f" returned: 0 in 1.392s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:08 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f Jul 08 11:20:08 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:09 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-821d1428-335e-4fb1-b205-6b01905b073f" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "cinder-quobyte-821d1428-335e-4fb1-b205-6b01905b073f" released by "delete_volume" :: held 2.305s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Created reservations ['287b17c2-d003-4158-b1b8-0f1912782284', 'd46be782-59fe-4f27-a2ec-be640b1c761b', 'cfc8a649-e931-44f6-a53c-1da0a0d64395', 'd622110f-e428-4907-a56a-e0b8ec0c6eff'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:09 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:09 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:10 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.797s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:10 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Deleted volume successfully. Jul 08 11:20:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-54a037fe-e8c9-47d5-9e7b-dd4745b0fa8d tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "cinder-821d1428-335e-4fb1-b205-6b01905b073f-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Flow 'volume_create_manager' (b37a5067-2d13-4392-a275-434ffbfd6766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557dc9cc-ba35-43c3-ad13-6e343bf23b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557dc9cc-ba35-43c3-ad13-6e343bf23b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-856255615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a84613-18fd-449e-822b-3bdf4ce55856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2f5f5e85ad47e489396d61ff12c5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:11Z,use_quota=True,user_id='34b6ca5cd7ed4a4f96114b76b7660c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f282a01-14c9-4197-aac2-033f20a58a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f282a01-14c9-4197-aac2-033f20a58a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c170841-65a7-4e00-b337-c9dbdc93709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c170841-65a7-4e00-b337-c9dbdc93709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a84613-18fd-449e-822b-3bdf4ce55856', 'volume_name': 'volume-11a84613-18fd-449e-822b-3bdf4ce55856', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81e4619-ca93-4374-a9e0-7f59657d36b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81e4619-ca93-4374-a9e0-7f59657d36b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f743071-f36b-4938-8327-86e96110075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume 11a84613-18fd-449e-822b-3bdf4ce55856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a84613-18fd-449e-822b-3bdf4ce55856', 'volume_size': 1} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-856255615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a84613-18fd-449e-822b-3bdf4ce55856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2f5f5e85ad47e489396d61ff12c5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:11Z,use_quota=True,user_id='34b6ca5cd7ed4a4f96114b76b7660c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Creating volume 11a84613-18fd-449e-822b-3bdf4ce55856 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:11 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:11 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 1073741824 Jul 08 11:20:11 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:12 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 1073741824" returned: 0 in 1.247s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:12 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 Jul 08 11:20:12 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:13 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856" returned: 0 in 0.884s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f743071-f36b-4938-8327-86e96110075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a84613-18fd-449e-822b-3bdf4ce55856', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176928e-7051-4d03-973b-0152737de0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:13 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Volume volume-11a84613-18fd-449e-822b-3bdf4ce55856 (11a84613-18fd-449e-822b-3bdf4ce55856): created successfully Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176928e-7051-4d03-973b-0152737de0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Flow 'volume_create_manager' (b37a5067-2d13-4392-a275-434ffbfd6766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8863a0c5-1363-46bd-9694-3bcb83c670d4 tempest-VolumeQuotasAdminTestJSON-1084957432 None] Created volume successfully. Jul 08 11:20:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1cd4a1c-5d51-40ff-9e75-cdefc0a53741 tempest-VolumeQuotasAdminTestJSON-695259405 None] Transfer volume completed successfully. Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Acquiring lock "cinder-11a84613-18fd-449e-822b-3bdf4ce55856-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "cinder-11a84613-18fd-449e-822b-3bdf4ce55856-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Acquiring lock "cinder-quobyte-11a84613-18fd-449e-822b-3bdf4ce55856" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "cinder-quobyte-11a84613-18fd-449e-822b-3bdf4ce55856" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6ed09-09d9-4ff6-9ef9-64437e8cbbd2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:16 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 Jul 08 11:20:16 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:17 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856" returned: 0 in 1.111s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:17 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856 Jul 08 11:20:17 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (5dc36d83-f1ee-465f-a35f-baa64b4ea9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5363d-c7b5-4b1e-8132-462620eb8c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf5363d-c7b5-4b1e-8132-462620eb8c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678047355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99d11f9-a751-4a05-9f67-bd819c60dbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:18Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce8b0ea-3410-4cee-bf22-a539659a973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce8b0ea-3410-4cee-bf22-a539659a973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9240d5-b03e-4efe-baae-74a136f1329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9240d5-b03e-4efe-baae-74a136f1329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99d11f9-a751-4a05-9f67-bd819c60dbfc', 'volume_name': 'volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23353737-ed12-4caa-9835-2d18e40f911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23353737-ed12-4caa-9835-2d18e40f911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785956e-a29d-4822-91a8-eb042429b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Volume d99d11f9-a751-4a05-9f67-bd819c60dbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc', 'volume_size': 1} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1678047355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99d11f9-a751-4a05-9f67-bd819c60dbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:18Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Creating volume d99d11f9-a751-4a05-9f67-bd819c60dbfc {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:18 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:18 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc 1073741824 Jul 08 11:20:18 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:19 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11a84613-18fd-449e-822b-3bdf4ce55856" returned: 0 in 1.118s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "cinder-quobyte-11a84613-18fd-449e-822b-3bdf4ce55856" released by "delete_volume" :: held 2.292s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Created reservations ['87a35f51-3f98-4474-b6c3-9e838a7269c3', 'c59c1903-e0ab-4a0e-b4df-b62f6c1a3922', '0f3f4d58-f90b-425e-8eb5-c148c9d8629a', 'c7f1c02a-c916-4503-9e32-7f7efb7d69f5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:19 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:19 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:19 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.753s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Deleted volume successfully. Jul 08 11:20:19 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e356fc72-074a-48f8-8cc2-3f575e9658c7 tempest-VolumeQuotasAdminTestJSON-313132877 None] Lock "cinder-11a84613-18fd-449e-822b-3bdf4ce55856-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc 1073741824" returned: 0 in 1.337s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:20 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc Jul 08 11:20:20 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:20 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc" returned: 0 in 0.934s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785956e-a29d-4822-91a8-eb042429b214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee854f84-6bdf-4f6b-9c6a-9156b8cd91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Volume volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc (d99d11f9-a751-4a05-9f67-bd819c60dbfc): created successfully Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee854f84-6bdf-4f6b-9c6a-9156b8cd91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (5dc36d83-f1ee-465f-a35f-baa64b4ea9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-63acd2b5-69dc-4187-b749-f1d58965f0a8 tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-d99d11f9-a751-4a05-9f67-bd819c60dbfc-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "cinder-d99d11f9-a751-4a05-9f67-bd819c60dbfc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-quobyte-d99d11f9-a751-4a05-9f67-bd819c60dbfc" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-d99d11f9-a751-4a05-9f67-bd819c60dbfc" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a2a14-ee2e-4d05-8d0f-47dffba20ee6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:22 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc Jul 08 11:20:22 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:23 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc" returned: 0 in 1.123s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:23 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc Jul 08 11:20:23 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:24 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d99d11f9-a751-4a05-9f67-bd819c60dbfc" returned: 0 in 1.012s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-d99d11f9-a751-4a05-9f67-bd819c60dbfc" released by "delete_volume" :: held 2.217s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Created reservations ['0abce924-c925-4f35-bf97-01f8d1ac561d', 'd0baad55-0469-442f-83f1-3711b2f6bd35', '9ba9882c-523f-4c80-984f-add60105ecdc', '324e636a-f11f-496d-9b85-8231ed7a783e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:24 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:24 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:25 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.342s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:25 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Deleted volume successfully. Jul 08 11:20:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98361e8b-f58d-44cf-9341-3fe598590236 tempest-VolumesActionsTest-597653194 None] Lock "cinder-d99d11f9-a751-4a05-9f67-bd819c60dbfc-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (3d14ca4f-845c-4e03-861c-2cc5459955a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82cbf56-f108-430d-826e-1a52342d8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82cbf56-f108-430d-826e-1a52342d8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2146491322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578e01d-bbfa-48d2-8456-379140a79be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:27Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7bc20e-f27c-4d9b-862b-ad6e561c6eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac7bc20e-f27c-4d9b-862b-ad6e561c6eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a363b027-4ebc-4336-9346-55747a51b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a363b027-4ebc-4336-9346-55747a51b66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1578e01d-bbfa-48d2-8456-379140a79be9', 'volume_name': 'volume-1578e01d-bbfa-48d2-8456-379140a79be9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa0e43a-3dcb-42a5-a662-9ba35133571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa0e43a-3dcb-42a5-a662-9ba35133571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce27330-d924-4db1-813c-586dc7327ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:26 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Volume 1578e01d-bbfa-48d2-8456-379140a79be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1578e01d-bbfa-48d2-8456-379140a79be9', 'volume_size': 1} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2146491322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578e01d-bbfa-48d2-8456-379140a79be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:27Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Creating volume 1578e01d-bbfa-48d2-8456-379140a79be9 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:26 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:27 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 1073741824 Jul 08 11:20:27 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:28 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 1073741824" returned: 0 in 1.158s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:28 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 Jul 08 11:20:28 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:28 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9" returned: 0 in 0.812s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce27330-d924-4db1-813c-586dc7327ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1578e01d-bbfa-48d2-8456-379140a79be9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fd65fb-a500-4b3c-a2e8-2e20e823f2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Volume volume-1578e01d-bbfa-48d2-8456-379140a79be9 (1578e01d-bbfa-48d2-8456-379140a79be9): created successfully Jul 08 11:20:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fd65fb-a500-4b3c-a2e8-2e20e823f2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (3d14ca4f-845c-4e03-861c-2cc5459955a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-99767a1a-3022-4fa9-9a87-9db681a6e0da tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-1578e01d-bbfa-48d2-8456-379140a79be9-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "cinder-1578e01d-bbfa-48d2-8456-379140a79be9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-quobyte-1578e01d-bbfa-48d2-8456-379140a79be9" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-1578e01d-bbfa-48d2-8456-379140a79be9" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[947bf08e-345d-4be4-8913-1512562bc85d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:30 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 Jul 08 11:20:30 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:31 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9" returned: 0 in 1.041s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:31 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9 Jul 08 11:20:31 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:32 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1578e01d-bbfa-48d2-8456-379140a79be9" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-1578e01d-bbfa-48d2-8456-379140a79be9" released by "delete_volume" :: held 1.904s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Created reservations ['b5fa0995-8c11-4a93-a759-e6acb69b7993', '3559fc98-9a91-4592-bbdf-204de39f0c59', 'c29ba1f4-8100-41f0-ae6c-a6ca78f03bf1', '21f8e226-3c94-41fa-a8b4-5feeddd35f31'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:32 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:32 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:33 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.944s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Deleted volume successfully. Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (596beca7-f461-42b0-a297-e3f094486b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f968a-984b-4c3d-810e-e5e87360ef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-24bbae5e-c362-40c8-bc06-b909a91de0d5 tempest-VolumesActionsTest-597653194 None] Lock "cinder-1578e01d-bbfa-48d2-8456-379140a79be9-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f968a-984b-4c3d-810e-e5e87360ef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130393689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5955ae90-2285-444b-8808-d9d577c9bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:33Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a390e4-c2e7-409c-ae8d-b81ba6f1a649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a390e4-c2e7-409c-ae8d-b81ba6f1a649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c7c3f-73a2-4d6f-a975-cd4dbf381ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c7c3f-73a2-4d6f-a975-cd4dbf381ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5955ae90-2285-444b-8808-d9d577c9bb02', 'volume_name': 'volume-5955ae90-2285-444b-8808-d9d577c9bb02', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b228f1bc-e925-4e69-b2be-a5d1ac484c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b228f1bc-e925-4e69-b2be-a5d1ac484c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb049c85-739b-4be4-af89-6a508862fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:33 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Volume 5955ae90-2285-444b-8808-d9d577c9bb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5955ae90-2285-444b-8808-d9d577c9bb02', 'volume_size': 1} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-130393689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5955ae90-2285-444b-8808-d9d577c9bb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:33Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Creating volume 5955ae90-2285-444b-8808-d9d577c9bb02 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:33 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:33 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 1073741824 Jul 08 11:20:33 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:34 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 1073741824" returned: 0 in 1.023s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:34 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 Jul 08 11:20:34 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:35 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02" returned: 0 in 0.688s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb049c85-739b-4be4-af89-6a508862fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5955ae90-2285-444b-8808-d9d577c9bb02', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55e1708-cf62-4ab8-a9b2-f5ae0b6f9e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:35 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Volume volume-5955ae90-2285-444b-8808-d9d577c9bb02 (5955ae90-2285-444b-8808-d9d577c9bb02): created successfully Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55e1708-cf62-4ab8-a9b2-f5ae0b6f9e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (596beca7-f461-42b0-a297-e3f094486b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-df2358ee-de84-43c9-ac1a-59fb153d294b tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-5955ae90-2285-444b-8808-d9d577c9bb02-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "cinder-5955ae90-2285-444b-8808-d9d577c9bb02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-quobyte-5955ae90-2285-444b-8808-d9d577c9bb02" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-5955ae90-2285-444b-8808-d9d577c9bb02" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef79d8b-d31d-40ef-8a25-cdb4d0b1baf2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:35 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 Jul 08 11:20:35 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:36 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02" returned: 0 in 1.274s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:37 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02 Jul 08 11:20:37 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:37 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5955ae90-2285-444b-8808-d9d577c9bb02" returned: 0 in 0.984s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-5955ae90-2285-444b-8808-d9d577c9bb02" released by "delete_volume" :: held 2.324s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Created reservations ['ec36034d-846b-47c5-81ab-3e86cbeec8fd', 'a25cf1ab-bada-42ce-9766-79ed048e754f', 'af0e27d6-be07-4f9d-b79d-ce39df422f72', '90375bb7-df85-42ba-aee5-c384688651c2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:38 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:38 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:39 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.022s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:39 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Deleted volume successfully. Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-523a35b1-9b63-4c72-9922-dbbfb1d21003 tempest-VolumesActionsTest-597653194 None] Lock "cinder-5955ae90-2285-444b-8808-d9d577c9bb02-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (3d38f1db-078d-44d3-a758-0f3214d94f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8712115-fa49-4285-b64c-81ee1747c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8712115-fa49-4285-b64c-81ee1747c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361482879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df0549d-4483-453f-aedf-23d47a1115d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:40Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973c786f-f616-491e-a675-89a1cace2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973c786f-f616-491e-a675-89a1cace2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d908e1f4-1a47-41de-8258-5b1c439d099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d908e1f4-1a47-41de-8258-5b1c439d099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df0549d-4483-453f-aedf-23d47a1115d5', 'volume_name': 'volume-5df0549d-4483-453f-aedf-23d47a1115d5', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa96f2a-272d-4456-aaf6-1ca88125ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa96f2a-272d-4456-aaf6-1ca88125ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b45a23-9f7e-4186-8bc8-0cb96bb62b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Volume 5df0549d-4483-453f-aedf-23d47a1115d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df0549d-4483-453f-aedf-23d47a1115d5', 'volume_size': 1} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361482879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df0549d-4483-453f-aedf-23d47a1115d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:40Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Creating volume 5df0549d-4483-453f-aedf-23d47a1115d5 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:39 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:39 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 1073741824 Jul 08 11:20:39 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:40 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 1073741824" returned: 0 in 0.943s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:40 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 Jul 08 11:20:40 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:41 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5" returned: 0 in 0.700s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b45a23-9f7e-4186-8bc8-0cb96bb62b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df0549d-4483-453f-aedf-23d47a1115d5', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c36ab4d-f9d4-47b9-ac1d-5f879fb39a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Volume volume-5df0549d-4483-453f-aedf-23d47a1115d5 (5df0549d-4483-453f-aedf-23d47a1115d5): created successfully Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c36ab4d-f9d4-47b9-ac1d-5f879fb39a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (3d38f1db-078d-44d3-a758-0f3214d94f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-64a8950e-ca91-4dae-992d-fe24f01300b2 tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-5df0549d-4483-453f-aedf-23d47a1115d5-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "cinder-5df0549d-4483-453f-aedf-23d47a1115d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Acquiring lock "cinder-quobyte-5df0549d-4483-453f-aedf-23d47a1115d5" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-5df0549d-4483-453f-aedf-23d47a1115d5" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cefd61e-d373-480c-8801-e16b106501fa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:42 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 Jul 08 11:20:42 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:43 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5" returned: 0 in 1.005s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:43 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5 Jul 08 11:20:43 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Flow 'volume_create_manager' (b7f1d8bb-e9b8-40f0-89f0-3ffb43c9385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f345e763-e51d-4808-b998-41d74bea1966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f345e763-e51d-4808-b998-41d74bea1966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-983815593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ffde7a-39a8-4a61-a248-e5eedbd83b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5593dabd87464a038ce55a5d7ad8647c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:44Z,use_quota=True,user_id='eab679da071b443382fa9e1bd7cc0d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7295962e-9aa3-468a-8632-7cb3a7beb875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7295962e-9aa3-468a-8632-7cb3a7beb875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d37376-1d8f-482c-9ebd-e3c1c4a90884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d37376-1d8f-482c-9ebd-e3c1c4a90884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ffde7a-39a8-4a61-a248-e5eedbd83b96', 'volume_name': 'volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82782268-7573-4429-93e3-45f1b6a6f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82782268-7573-4429-93e3-45f1b6a6f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4181907f-aa64-49b8-b262-e8686f01e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:43 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Volume 57ffde7a-39a8-4a61-a248-e5eedbd83b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96', 'volume_size': 1} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-983815593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ffde7a-39a8-4a61-a248-e5eedbd83b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5593dabd87464a038ce55a5d7ad8647c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:44Z,use_quota=True,user_id='eab679da071b443382fa9e1bd7cc0d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Creating volume 57ffde7a-39a8-4a61-a248-e5eedbd83b96 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:43 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:44 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 1073741824 Jul 08 11:20:44 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:44 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5df0549d-4483-453f-aedf-23d47a1115d5" returned: 0 in 0.994s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "cinder-quobyte-5df0549d-4483-453f-aedf-23d47a1115d5" released by "delete_volume" :: held 2.077s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Created reservations ['2f22c980-4ee0-4ec1-b818-6dda73859daa', '840d7df7-f6ab-41cd-a278-d50fe257fee0', '4b69bddc-1b6d-4df8-b207-5720e090808c', '67511d1c-7158-48a3-9263-eb9f4bab9321'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:44 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:44 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:45 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:45 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:45 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Deleted volume successfully. Jul 08 11:20:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5cf47e37-0909-4c5c-b5be-9a07741d73e8 tempest-VolumesActionsTest-597653194 None] Lock "cinder-5df0549d-4483-453f-aedf-23d47a1115d5-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:45 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 1073741824" returned: 0 in 1.140s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:45 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 Jul 08 11:20:45 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:46 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (c8f8e1c2-97a5-4b80-aeb2-303555480d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efec9e5-6a5d-4f2a-8d3a-16119e518a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96" returned: 0 in 0.965s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efec9e5-6a5d-4f2a-8d3a-16119e518a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559014538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6afc888-ae60-4b9f-a1b8-6bfb67cd966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:46Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0bdfa6-210f-402d-9fd5-4a5c7b88845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0bdfa6-210f-402d-9fd5-4a5c7b88845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63a4a65-6c79-4ac9-841a-f820f5d502b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63a4a65-6c79-4ac9-841a-f820f5d502b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6afc888-ae60-4b9f-a1b8-6bfb67cd966f', 'volume_name': 'volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084929ba-2153-478f-8479-5aeca4505bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084929ba-2153-478f-8479-5aeca4505bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d303475e-769b-4b2e-8ca8-5d1fec3bc874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Volume d6afc888-ae60-4b9f-a1b8-6bfb67cd966f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f', 'volume_size': 1} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559014538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6afc888-ae60-4b9f-a1b8-6bfb67cd966f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a56524fdeae4dbc80053b3a5f61212d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:46Z,use_quota=True,user_id='e325d9ec8a344c8a8eda626cd0524132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Creating volume d6afc888-ae60-4b9f-a1b8-6bfb67cd966f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:46 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4181907f-aa64-49b8-b262-e8686f01e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f 1073741824 Jul 08 11:20:46 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13d2652-2264-4284-9500-7b1403d8c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Volume volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 (57ffde7a-39a8-4a61-a248-e5eedbd83b96): created successfully Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13d2652-2264-4284-9500-7b1403d8c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Flow 'volume_create_manager' (b7f1d8bb-e9b8-40f0-89f0-3ffb43c9385d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fd56c11d-5100-4217-bfe3-7a2fd240e24d tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Created volume successfully. Jul 08 11:20:47 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f 1073741824" returned: 0 in 1.021s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:47 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f Jul 08 11:20:47 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:47 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=76,cinder:INSERT=24,cinder:UPDATE=92,cinder:DELETE=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d303475e-769b-4b2e-8ca8-5d1fec3bc874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00550578-67da-49d9-b6f8-011f0b71cd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=97,cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=11 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:20:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Volume volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f (d6afc888-ae60-4b9f-a1b8-6bfb67cd966f): created successfully Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00550578-67da-49d9-b6f8-011f0b71cd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Flow 'volume_create_manager' (c8f8e1c2-97a5-4b80-aeb2-303555480d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8830bcfc-a8d3-4577-8bf0-ecd45093c063 tempest-VolumesActionsTest-221013301 None] Created volume successfully. Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "cinder-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Acquiring lock "cinder-quobyte-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "cinder-quobyte-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6dca7-509d-4d9a-a64e-dfeed4effdb0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:48 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f Jul 08 11:20:48 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:49 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" returned: 0 in 0.794s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:49 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f Jul 08 11:20:49 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:50 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" returned: 0 in 0.656s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbe61a-53bf-419b-b544-50f8a24244e6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "cinder-quobyte-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f" released by "delete_volume" :: held 1.505s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Created reservations ['4ea28699-f84d-487b-81a7-8fbd4b7b6f23', 'e88eb5f3-98fd-40a9-ba6c-0c47482a0752', '5a9c479c-865a-4898-8d89-8674a874d858', '80a9830a-9003-47b6-9267-e67e1c9a09a9'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:20:50 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 Jul 08 11:20:50 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:50 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:50 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:51 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96" returned: 0 in 0.907s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:51 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Deleted volume successfully. Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bbb5542-c1d2-4976-a3de-e976ae4eef45', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:20:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-427466f8-1867-47b9-af89-a37949995e4b tempest-VolumesActionsTest-221013301 None] Lock "cinder-d6afc888-ae60-4b9f-a1b8-6bfb67cd966f-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:20:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-d5df8cbf-e2ef-4c5a-8e8d-81d7781d60df req-fb5b2a80-fdc3-4754-aaab-fcc3a45b832a tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] attachment_update completed successfully. Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:52 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:20:52 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:53 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.967s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:20:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:20:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:20:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Flow 'volume_create_manager' (2030c412-3dbb-421e-80dc-88111aac8ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b747bf75-9ecf-4d15-a37d-a4bd2f7b46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b747bf75-9ecf-4d15-a37d-a4bd2f7b46b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-258383636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de259a7d-d61e-4267-badf-750a2f8510f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5363777b12426ea54d5c97eef118d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:55Z,use_quota=True,user_id='6aa960c043364bac939020086138262f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e6d67a-ed0d-4b05-87c0-ef8925f9f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e6d67a-ed0d-4b05-87c0-ef8925f9f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467bbccf-d9fa-48b0-b3cf-c6be867475ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467bbccf-d9fa-48b0-b3cf-c6be867475ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de259a7d-d61e-4267-badf-750a2f8510f5', 'volume_name': 'volume-de259a7d-d61e-4267-badf-750a2f8510f5', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6955e1-0f5a-4ca6-bf8f-d82456d50db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6955e1-0f5a-4ca6-bf8f-d82456d50db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04531f46-61b2-4f77-96df-8518884ce032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:54 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Volume de259a7d-d61e-4267-badf-750a2f8510f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de259a7d-d61e-4267-badf-750a2f8510f5', 'volume_size': 1} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-258383636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de259a7d-d61e-4267-badf-750a2f8510f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe5363777b12426ea54d5c97eef118d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:55Z,use_quota=True,user_id='6aa960c043364bac939020086138262f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Creating volume de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:20:54 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:20:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:54 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 1073741824 Jul 08 11:20:54 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:55 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 1073741824" returned: 0 in 0.979s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:55 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 Jul 08 11:20:55 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:56 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5" returned: 0 in 0.683s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04531f46-61b2-4f77-96df-8518884ce032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de259a7d-d61e-4267-badf-750a2f8510f5', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56da0f81-b9c7-42ab-b20e-30247e566ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Volume volume-de259a7d-d61e-4267-badf-750a2f8510f5 (de259a7d-d61e-4267-badf-750a2f8510f5): created successfully Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56da0f81-b9c7-42ab-b20e-30247e566ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Flow 'volume_create_manager' (2030c412-3dbb-421e-80dc-88111aac8ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6286ce8f-b6e7-4c38-8491-859b2df37baf tempest-SnapshotMetadataTestJSON-1653775843 None] Created volume successfully. Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:20:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Creating offline snapshot 1a27592a-6529-4f26-992b-ebe71c43bb8d of volume de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:20:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32170c-36a2-4f37-973b-a17859c9cb45]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:20:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:57 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 Jul 08 11:20:57 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:57 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5" returned: 0 in 0.935s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:58 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d 1G Jul 08 11:20:58 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (fef35af6-1ab7-4b2d-9252-155ccd42549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d619e93-eb89-4093-bfa7-c3a8b5b6c27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d619e93-eb89-4093-bfa7-c3a8b5b6c27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-465768468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b893ebcb-8fa0-407d-80be-fbd25a64cb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:58Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27af976d-e231-406d-bf32-1e8a18690f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27af976d-e231-406d-bf32-1e8a18690f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888a9e34-eb34-470c-9800-e2e7ba01564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888a9e34-eb34-470c-9800-e2e7ba01564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b893ebcb-8fa0-407d-80be-fbd25a64cb2d', 'volume_name': 'volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cb59d6-d579-4082-9bff-a7134000f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cb59d6-d579-4082-9bff-a7134000f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872819d8-9d49-497a-b1e9-0c67196c6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:20:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Volume b893ebcb-8fa0-407d-80be-fbd25a64cb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d', 'volume_size': 1} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:20:58 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d 1G" returned: 0 in 1.005s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de259a7d-d61e-4267-badf-750a2f8510f5 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:59 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de259a7d-d61e-4267-badf-750a2f8510f5 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d Jul 08 11:20:59 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:20:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-5f1bc7b1-5d8e-4045-9766-344351ed4a90 req-f715fb8d-ac8d-4218-bc1b-4f2fb96bf8eb tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Terminate volume connection completed successfully. Jul 08 11:20:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-5f1bc7b1-5d8e-4045-9766-344351ed4a90 req-f715fb8d-ac8d-4218-bc1b-4f2fb96bf8eb tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Deleting attachment 1bbb5542-c1d2-4976-a3de-e976ae4eef45. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:20:59 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 08 11:20:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de259a7d-d61e-4267-badf-750a2f8510f5 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:20:59 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d is being set with open permissions: ugo+rw Jul 08 11:20:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:20:59 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d Jul 08 11:20:59 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:00 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d" returned: 0 in 0.687s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:00 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info Jul 08 11:21:00 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:01 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:01 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info is being set with open permissions: ugo+rw Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "cinder-57ffde7a-39a8-4a61-a248-e5eedbd83b96-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:01 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info Jul 08 11:21:01 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "cinder-57ffde7a-39a8-4a61-a248-e5eedbd83b96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "cinder-quobyte-57ffde7a-39a8-4a61-a248-e5eedbd83b96" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "cinder-quobyte-57ffde7a-39a8-4a61-a248-e5eedbd83b96" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6928db44-1efe-4606-ace8-00f74b1a6e66]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:01 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 Jul 08 11:21:01 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:01 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.info" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.966s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.531s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-465768468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b893ebcb-8fa0-407d-80be-fbd25a64cb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:20:58Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Creating volume b893ebcb-8fa0-407d-80be-fbd25a64cb2d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:01 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:01 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d 1073741824 Jul 08 11:21:01 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-550b7b80-550e-44cd-b58f-8cbbdadc80ed tempest-SnapshotMetadataTestJSON-1653775843 None] Create snapshot completed successfully Jul 08 11:21:02 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96" returned: 0 in 0.896s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:02 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96 Jul 08 11:21:02 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:03 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d 1073741824" returned: 0 in 1.041s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:03 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d Jul 08 11:21:03 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:03 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-57ffde7a-39a8-4a61-a248-e5eedbd83b96" returned: 0 in 0.920s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "cinder-quobyte-57ffde7a-39a8-4a61-a248-e5eedbd83b96" released by "delete_volume" :: held 1.883s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "cinder-1a27592a-6529-4f26-992b-ebe71c43bb8d-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-1a27592a-6529-4f26-992b-ebe71c43bb8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "cinder-quobyte-1a27592a-6529-4f26-992b-ebe71c43bb8d" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-1a27592a-6529-4f26-992b-ebe71c43bb8d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Deleting offline snapshot 1a27592a-6529-4f26-992b-ebe71c43bb8d of volume de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] snapshot_file for this snap is: volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Created reservations ['b9d4895f-e0a6-4132-afc8-6d9df67ce8d4', 'ffcb7634-e735-427f-a378-2a6e0e50a50c', 'a751c6bc-d353-4c41-b15c-e62e2d74a3fa', 'cb5b05d7-41eb-4254-9098-9e11d25e8834'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9187936b-d8ca-4e6a-baae-61545441e97d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:03 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:03 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:03 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d Jul 08 11:21:03 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (e504cf38-6ce7-42e6-977c-94980cc8a140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e87d96-7434-47dd-8c4d-4c624ca8d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e87d96-7434-47dd-8c4d-4c624ca8d5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1558507925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a812a6ec-1299-4e84-8835-5307ed9eee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:04Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438b5e1d-ab5b-480e-9f3e-6f141e8210cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438b5e1d-ab5b-480e-9f3e-6f141e8210cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb349476-2347-445c-9c3f-5e8dfa47d07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb349476-2347-445c-9c3f-5e8dfa47d07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a812a6ec-1299-4e84-8835-5307ed9eee95', 'volume_name': 'volume-a812a6ec-1299-4e84-8835-5307ed9eee95', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db384a29-a283-43e6-91ea-28cd720fd4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db384a29-a283-43e6-91ea-28cd720fd4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10efb09-0f48-4485-b7f3-01da32af1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Volume a812a6ec-1299-4e84-8835-5307ed9eee95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a812a6ec-1299-4e84-8835-5307ed9eee95', 'volume_size': 1} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:03 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" returned: 0 in 0.913s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1558507925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a812a6ec-1299-4e84-8835-5307ed9eee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:04Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Creating volume a812a6ec-1299-4e84-8835-5307ed9eee95 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:04 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 1073741824 Jul 08 11:21:04 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872819d8-9d49-497a-b1e9-0c67196c6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6a1aac-60c0-4960-a69b-cca3fabfe13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Volume volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d (b893ebcb-8fa0-407d-80be-fbd25a64cb2d): created successfully Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6a1aac-60c0-4960-a69b-cca3fabfe13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (fef35af6-1ab7-4b2d-9252-155ccd42549e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c58b4194-17a1-41ff-ab42-c88c6ca26e0e tempest-AttachVolumeNegativeTest-1942800585 None] Created volume successfully. Jul 08 11:21:04 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.815s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Deleted volume successfully. Jul 08 11:21:04 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d" returned: 0 in 0.991s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de259a7d-d61e-4267-badf-750a2f8510f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-12416f5b-c372-4c97-9b08-93cd68796643 tempest-TestServerVolumeAttachScenarioOldVersion-2086687911 None] Lock "cinder-57ffde7a-39a8-4a61-a248-e5eedbd83b96-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[417fe705-0fab-4996-bd56-a23c3c93e25c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:04 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 Jul 08 11:21:04 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:04 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 1073741824" returned: 0 in 0.959s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:04 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 Jul 08 11:21:05 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:05 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:05 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d Jul 08 11:21:05 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:05 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95" returned: 0 in 0.782s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10efb09-0f48-4485-b7f3-01da32af1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a812a6ec-1299-4e84-8835-5307ed9eee95', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7907df-7a31-4e2f-a0c5-93a21d9c4379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Volume volume-a812a6ec-1299-4e84-8835-5307ed9eee95 (a812a6ec-1299-4e84-8835-5307ed9eee95): created successfully Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7907df-7a31-4e2f-a0c5-93a21d9c4379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (e504cf38-6ce7-42e6-977c-94980cc8a140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fd7b456e-5b89-4a05-8625-91b4548718ab tempest-VolumesListAdminTestJSON-441213924 None] Created volume successfully. Jul 08 11:21:06 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d" returned: 0 in 0.936s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:06 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d Jul 08 11:21:06 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:06 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5.1a27592a-6529-4f26-992b-ebe71c43bb8d" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-1a27592a-6529-4f26-992b-ebe71c43bb8d" released by "_delete_snapshot" :: held 3.676s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" released by "delete_snapshot" :: held 3.729s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Created reservations ['57e797a7-c749-4dcf-b20f-a8f58035b65f', '983e819a-bc0a-41a6-94c6-a1857cea730c', '277110ae-efc6-45ab-a777-b26c1f2ec051', '61a620c9-3291-4731-8925-680fbfd012bc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Delete snapshot completed successfully. Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd98722a-93d5-4458-96c8-fa4b75b9efd0 tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-1a27592a-6529-4f26-992b-ebe71c43bb8d-delete_snapshot" released by "delete_snapshot" :: held 3.978s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (43d241ed-1c92-4421-a3cc-714686a692ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854d6a0a-5ab6-4183-aeaf-8650ec21cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854d6a0a-5ab6-4183-aeaf-8650ec21cc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-114680064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592dffc4-08a3-476a-98d4-0d47dc24975e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:07Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa159910-e671-45ae-93eb-5473c3cddedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa159910-e671-45ae-93eb-5473c3cddedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092db500-58d5-4fad-8bdb-4e49cba51d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092db500-58d5-4fad-8bdb-4e49cba51d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592dffc4-08a3-476a-98d4-0d47dc24975e', 'volume_name': 'volume-592dffc4-08a3-476a-98d4-0d47dc24975e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a6ddb0-fae2-496c-939d-1667ec432f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a6ddb0-fae2-496c-939d-1667ec432f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c356e6-b458-411d-aee6-432da857c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:07 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Volume 592dffc4-08a3-476a-98d4-0d47dc24975e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592dffc4-08a3-476a-98d4-0d47dc24975e', 'volume_size': 1} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-114680064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592dffc4-08a3-476a-98d4-0d47dc24975e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:07Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Creating volume 592dffc4-08a3-476a-98d4-0d47dc24975e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:07 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "cinder-de259a7d-d61e-4267-badf-750a2f8510f5-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:07 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e 1073741824 Jul 08 11:21:07 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-de259a7d-d61e-4267-badf-750a2f8510f5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37bb562-899e-4bbf-b00b-3704dc4f73e9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:07 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 Jul 08 11:21:07 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:08 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e 1073741824" returned: 0 in 0.956s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:08 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e Jul 08 11:21:08 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:08 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5" returned: 0 in 0.864s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:08 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5 Jul 08 11:21:08 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:09 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e" returned: 0 in 0.675s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.210s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c356e6-b458-411d-aee6-432da857c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592dffc4-08a3-476a-98d4-0d47dc24975e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884e9fba-d246-48ca-a521-cd7b7064e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f9d93-334b-4e20-ba3c-59789a07abb3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Volume volume-592dffc4-08a3-476a-98d4-0d47dc24975e (592dffc4-08a3-476a-98d4-0d47dc24975e): created successfully Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884e9fba-d246-48ca-a521-cd7b7064e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (43d241ed-1c92-4421-a3cc-714686a692ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1b17f33f-c0cc-45bf-aac9-d3f97c10a44e tempest-VolumesListAdminTestJSON-441213924 None] Created volume successfully. Jul 08 11:21:09 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-de259a7d-d61e-4267-badf-750a2f8510f5" returned: 0 in 0.701s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-quobyte-de259a7d-d61e-4267-badf-750a2f8510f5" released by "delete_volume" :: held 1.641s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:09 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d Jul 08 11:21:09 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Created reservations ['d33bbc17-a20c-46f9-b2cf-ec0e9f96f26b', '7285c369-4ea0-48b1-b395-9bbc5042cdf1', 'f0afbcfd-cfff-481c-b51c-86c59f2a1dbe', '02e50aa1-986b-4ccd-aa22-1c563dff953b'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:09 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:09 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (dbe60abb-1a12-4cc1-a2bb-1ed46fc60b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd52a6f3-17a0-41cd-bdd3-cd1f87041910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:10 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" returned: 0 in 0.967s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd52a6f3-17a0-41cd-bdd3-cd1f87041910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-787672367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef611f4-06fe-484f-a189-006d2eb52bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:10Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b044c5da-9536-46b2-9f09-28d97d9480bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b044c5da-9536-46b2-9f09-28d97d9480bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc05fa6-3ffe-4aec-8a7e-5d5fa0c581e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc05fa6-3ffe-4aec-8a7e-5d5fa0c581e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef611f4-06fe-484f-a189-006d2eb52bc1', 'volume_name': 'volume-6ef611f4-06fe-484f-a189-006d2eb52bc1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdbfbf7-b3d4-4242-8dfd-3a59be7fc531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdbfbf7-b3d4-4242-8dfd-3a59be7fc531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dcbb28-5711-40cc-98bc-c33587503b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Volume 6ef611f4-06fe-484f-a189-006d2eb52bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef611f4-06fe-484f-a189-006d2eb52bc1', 'volume_size': 1} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-787672367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef611f4-06fe-484f-a189-006d2eb52bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2173037fa6744c989c1a6e17c9b23f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:10Z,use_quota=True,user_id='e41dc1221a2640b984aa0dbf0ddae639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Creating volume 6ef611f4-06fe-484f-a189-006d2eb52bc1 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:10 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:10 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.784s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:10 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 1073741824 Jul 08 11:21:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Deleted volume successfully. Jul 08 11:21:10 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed11c5ad-8956-4eee-a3ec-4a183a34e424', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:21:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-144ab8fb-20b7-444a-b9fd-179bf30d1f8c tempest-SnapshotMetadataTestJSON-1653775843 None] Lock "cinder-de259a7d-d61e-4267-badf-750a2f8510f5-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-97719ca3-2159-49b6-8196-dfc65f8f2976 req-6920811a-ee18-4b23-ae59-f629c83e4746 tempest-AttachVolumeNegativeTest-1942800585 None] attachment_update completed successfully. Jul 08 11:21:11 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 1073741824" returned: 0 in 0.972s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:11 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 Jul 08 11:21:11 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:12 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7dcbb28-5711-40cc-98bc-c33587503b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef611f4-06fe-484f-a189-006d2eb52bc1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115866b9-8726-406c-bed3-7d18d14febe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:12 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Volume volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 (6ef611f4-06fe-484f-a189-006d2eb52bc1): created successfully Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115866b9-8726-406c-bed3-7d18d14febe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Flow 'volume_create_manager' (dbe60abb-1a12-4cc1-a2bb-1ed46fc60b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-80d63df3-299b-4fad-9f54-39be748763af tempest-VolumesListAdminTestJSON-441213924 None] Created volume successfully. Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Flow 'volume_create_manager' (7cdc6a19-df9b-4811-b14e-d90292ec25b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b249d07a-fbd2-43cf-b5fb-a64fbf9f38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b249d07a-fbd2-43cf-b5fb-a64fbf9f38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57cbcda-ffff-4a58-89d6-5649ec8b5440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b40ce121714dcdbe7111aef7690943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:14Z,use_quota=True,user_id='c1a9d6f03939480390c145e72328ff24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a832224c-ff44-4101-ae08-eae1ff30dfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a832224c-ff44-4101-ae08-eae1ff30dfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b317b93f-8167-46ee-b4d3-6d90e4ba2418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b317b93f-8167-46ee-b4d3-6d90e4ba2418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57cbcda-ffff-4a58-89d6-5649ec8b5440', 'volume_name': 'volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f76f1-473a-43c1-9d0d-38f47a915c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f76f1-473a-43c1-9d0d-38f47a915c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e12910d-2e50-4a9b-8063-b63bc2491473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Volume c57cbcda-ffff-4a58-89d6-5649ec8b5440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440', 'volume_size': 1} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57cbcda-ffff-4a58-89d6-5649ec8b5440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b40ce121714dcdbe7111aef7690943',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:14Z,use_quota=True,user_id='c1a9d6f03939480390c145e72328ff24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Creating volume c57cbcda-ffff-4a58-89d6-5649ec8b5440 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:14 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:14 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 1073741824 Jul 08 11:21:14 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Flow 'volume_create_manager' (05636c87-5104-48b5-a1df-16b68342ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f8473a-4689-4a55-9736-8265f319de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f8473a-4689-4a55-9736-8265f319de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1763589100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a04271-8bea-420c-aa6c-c784d24231b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c2e1327e9c4093ae3e9f7a55a9bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:14Z,use_quota=True,user_id='a9e2e603bca14aa1bcd1e81d6ec7b57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad12d18-7d23-4937-8e08-6906683a2406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad12d18-7d23-4937-8e08-6906683a2406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b36dd-656a-42a4-aa53-7464e84d1d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0b36dd-656a-42a4-aa53-7464e84d1d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a04271-8bea-420c-aa6c-c784d24231b8', 'volume_name': 'volume-e2a04271-8bea-420c-aa6c-c784d24231b8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff780d4f-5f8e-415f-973f-03f5f080ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff780d4f-5f8e-415f-973f-03f5f080ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66aec10-ba83-4441-9d90-60a5e3236dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:14 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Volume e2a04271-8bea-420c-aa6c-c784d24231b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a04271-8bea-420c-aa6c-c784d24231b8', 'volume_size': 1} Jul 08 11:21:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:15 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 1073741824" returned: 0 in 1.019s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:15 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 Jul 08 11:21:15 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:16 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440" returned: 0 in 0.734s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1763589100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a04271-8bea-420c-aa6c-c784d24231b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c2e1327e9c4093ae3e9f7a55a9bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:14Z,use_quota=True,user_id='a9e2e603bca14aa1bcd1e81d6ec7b57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Creating volume e2a04271-8bea-420c-aa6c-c784d24231b8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:16 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e12910d-2e50-4a9b-8063-b63bc2491473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:16 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 1073741824 Jul 08 11:21:16 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f79d2cb-84c0-45df-8fa0-02a76662f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Volume volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 (c57cbcda-ffff-4a58-89d6-5649ec8b5440): created successfully Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f79d2cb-84c0-45df-8fa0-02a76662f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Flow 'volume_create_manager' (7cdc6a19-df9b-4811-b14e-d90292ec25b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fc34c340-d635-4229-93b6-352cdbcfb8d8 tempest-VolumesListAdminTestJSON-1843406794 None] Created volume successfully. Jul 08 11:21:17 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 1073741824" returned: 0 in 0.977s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:17 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 Jul 08 11:21:17 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Acquiring lock "cinder-c57cbcda-ffff-4a58-89d6-5649ec8b5440-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "cinder-c57cbcda-ffff-4a58-89d6-5649ec8b5440-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Acquiring lock "cinder-quobyte-c57cbcda-ffff-4a58-89d6-5649ec8b5440" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "cinder-quobyte-c57cbcda-ffff-4a58-89d6-5649ec8b5440" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5ee178-4acb-4f87-90a8-16b6838e2172]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-6ef611f4-06fe-484f-a189-006d2eb52bc1-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-6ef611f4-06fe-484f-a189-006d2eb52bc1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-quobyte-6ef611f4-06fe-484f-a189-006d2eb52bc1" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-6ef611f4-06fe-484f-a189-006d2eb52bc1" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:18 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 Jul 08 11:21:18 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba03539-3366-4231-b4bf-10a5ef468b76]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:18 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 Jul 08 11:21:18 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:18 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8" returned: 0 in 1.078s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66aec10-ba83-4441-9d90-60a5e3236dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a04271-8bea-420c-aa6c-c784d24231b8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a2f590-059e-4e89-b7a8-745f80a4a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Volume volume-e2a04271-8bea-420c-aa6c-c784d24231b8 (e2a04271-8bea-420c-aa6c-c784d24231b8): created successfully Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a2f590-059e-4e89-b7a8-745f80a4a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Flow 'volume_create_manager' (05636c87-5104-48b5-a1df-16b68342ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6b9605bd-62ad-4737-b491-9296207903b4 tempest-AbsoluteLimitsTests-1557057100 None] Created volume successfully. Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Acquiring lock "cinder-e2a04271-8bea-420c-aa6c-c784d24231b8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "cinder-e2a04271-8bea-420c-aa6c-c784d24231b8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Acquiring lock "cinder-quobyte-e2a04271-8bea-420c-aa6c-c784d24231b8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "cinder-quobyte-e2a04271-8bea-420c-aa6c-c784d24231b8" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:19 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440" returned: 0 in 1.211s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5329d8d8-953d-48b7-9fc3-9fc67cd80fb0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:19 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440 Jul 08 11:21:19 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:19 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1" returned: 0 in 1.193s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:19 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 Jul 08 11:21:19 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:19 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1 Jul 08 11:21:19 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:20 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c57cbcda-ffff-4a58-89d6-5649ec8b5440" returned: 0 in 0.969s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "cinder-quobyte-c57cbcda-ffff-4a58-89d6-5649ec8b5440" released by "delete_volume" :: held 2.279s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Created reservations ['703ed898-5eba-49a8-8b12-a277ca650561', 'b09e25f3-ce29-454f-ace2-10b829cb7c24', '2675aa00-d92a-4c17-a332-f10eea61fc95', 'df4859d5-f91b-4fae-b5a1-76345b24ca35'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:20 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6ef611f4-06fe-484f-a189-006d2eb52bc1" returned: 0 in 1.047s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:20 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-6ef611f4-06fe-484f-a189-006d2eb52bc1" released by "delete_volume" :: held 2.323s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8" returned: 0 in 1.278s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:20 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:20 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:20 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8 Jul 08 11:21:20 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Created reservations ['1beedb83-60ff-4ed7-a9f3-e8a5573db546', '11f9b010-2678-47fc-adaa-77e5ebc67e2a', 'cede5fba-b128-43c5-94ff-3b152bcd4f83', '236d3859-9cea-477c-a4f1-cdc2d596179a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:20 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:20 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:21 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.831s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Deleted volume successfully. Jul 08 11:21:21 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e2a04271-8bea-420c-aa6c-c784d24231b8" returned: 0 in 0.856s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "cinder-quobyte-e2a04271-8bea-420c-aa6c-c784d24231b8" released by "delete_volume" :: held 2.219s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d6fad954-1403-4049-a729-33de0cee1530 tempest-VolumesListAdminTestJSON-1843406794 None] Lock "cinder-c57cbcda-ffff-4a58-89d6-5649ec8b5440-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Created reservations ['33e067fd-b7d8-4334-af0c-8ada06217f3f', '66bc0e76-e462-4469-a152-172e4fd6bc9a', '9a271570-88c2-4f2e-a19c-3364c80f8b18', '845e3489-e489-484b-a659-9b785708cf6f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:21 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.851s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Deleted volume successfully. Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78a7cd56-ead4-4d55-980b-a1f82127e36e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-6ef611f4-06fe-484f-a189-006d2eb52bc1-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:21 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:21 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-592dffc4-08a3-476a-98d4-0d47dc24975e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-592dffc4-08a3-476a-98d4-0d47dc24975e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-quobyte-592dffc4-08a3-476a-98d4-0d47dc24975e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-592dffc4-08a3-476a-98d4-0d47dc24975e" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c6a41-ed7b-452b-a394-a57d53af2b45]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:21 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e Jul 08 11:21:21 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:22 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.732s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:22 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Deleted volume successfully. Jul 08 11:21:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-526786f2-250d-4b09-bc99-76159221b361 tempest-AbsoluteLimitsTests-1557057100 None] Lock "cinder-e2a04271-8bea-420c-aa6c-c784d24231b8-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:22 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e" returned: 0 in 0.892s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:22 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e Jul 08 11:21:22 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:23 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-592dffc4-08a3-476a-98d4-0d47dc24975e" returned: 0 in 0.708s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-592dffc4-08a3-476a-98d4-0d47dc24975e" released by "delete_volume" :: held 1.643s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Created reservations ['01e616c0-20bb-4ea9-8ec5-cb0467b1013e', '71654f1e-bd9a-4f0b-b20c-dad83399e81d', '910e5b5c-843f-4bc0-8fdf-e543296983c6', 'df74dfea-4bf6-4262-bd1d-0848a1da7391'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:23 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:23 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-a812a6ec-1299-4e84-8835-5307ed9eee95-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-a812a6ec-1299-4e84-8835-5307ed9eee95-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "cinder-quobyte-a812a6ec-1299-4e84-8835-5307ed9eee95" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-a812a6ec-1299-4e84-8835-5307ed9eee95" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89296a-ad0b-4206-b9f2-3a6e63fe4fbd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:24 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 Jul 08 11:21:24 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:24 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.092s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Deleted volume successfully. Jul 08 11:21:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b6d778ea-5fe2-4660-8161-aa4e16ffde8d tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-592dffc4-08a3-476a-98d4-0d47dc24975e-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:25 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95" returned: 0 in 1.074s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:25 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95 Jul 08 11:21:25 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:26 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a812a6ec-1299-4e84-8835-5307ed9eee95" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-quobyte-a812a6ec-1299-4e84-8835-5307ed9eee95" released by "delete_volume" :: held 1.925s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Created reservations ['c76616db-98a6-49ab-a894-17ea2e575625', '70993458-8892-4bcf-b0cc-016dc65d5ebd', '2073591a-edc7-4245-a9d0-0583aeca1bfe', '77eabbfe-187e-4d48-99b6-5d0ee8d41e13'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:26 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:26 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:26 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.729s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Deleted volume successfully. Jul 08 11:21:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09816cb1-172a-4a81-80f2-a54db2d0ad0e tempest-VolumesListAdminTestJSON-441213924 None] Lock "cinder-a812a6ec-1299-4e84-8835-5307ed9eee95-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:21:36 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=90,cinder:SELECT=81,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:21:36 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=101,cinder:DELETE=7,cinder:SELECT=69,cinder:INSERT=18 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:21:38 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (b5dcef65-6f94-4a87-92e3-ce33819a8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bd6842-1889-4b26-8d2f-47e2ef8ccd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bd6842-1889-4b26-8d2f-47e2ef8ccd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1182716090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d076bfba-c08e-41ef-8298-8f09cfe8f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeefe1e43264e8bb4913fb4be8cf071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:39Z,use_quota=True,user_id='724b976eed004485a2c005f56ea2d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9441b1a8-270d-4c04-bcae-e4d22c491cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9441b1a8-270d-4c04-bcae-e4d22c491cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd512a1b-08be-40da-9638-362df0fe0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd512a1b-08be-40da-9638-362df0fe0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd076bfba-c08e-41ef-8298-8f09cfe8f1f6', 'volume_name': 'volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c22ef2f-136c-4089-8b4a-d8cc1eb2f009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c22ef2f-136c-4089-8b4a-d8cc1eb2f009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebf40aa-ca81-4e37-b309-ac9b7c954f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6', 'volume_size': 1} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1182716090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d076bfba-c08e-41ef-8298-8f09cfe8f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeefe1e43264e8bb4913fb4be8cf071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:39Z,use_quota=True,user_id='724b976eed004485a2c005f56ea2d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Creating volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:39 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:39 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 1073741824 Jul 08 11:21:39 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:40 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 1073741824" returned: 0 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:40 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 Jul 08 11:21:40 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:41 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" returned: 0 in 0.936s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebf40aa-ca81-4e37-b309-ac9b7c954f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a881c68-d1aa-4113-ba12-0db63339c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Volume volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 (d076bfba-c08e-41ef-8298-8f09cfe8f1f6): created successfully Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a881c68-d1aa-4113-ba12-0db63339c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (b5dcef65-6f94-4a87-92e3-ce33819a8254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2b11ded8-c58d-446d-93e2-c61b16569786 tempest-VolumesDeleteCascade-403727686 None] Created volume successfully. Jul 08 11:21:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Creating offline snapshot fbd17983-6b24-4aa8-b823-acd3a39097e3 of volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:21:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee791a9-1c54-4a96-8693-5b14fa188640]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:42 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 Jul 08 11:21:42 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:44 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" returned: 0 in 1.679s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:44 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 1G Jul 08 11:21:44 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Flow 'volume_create_manager' (fd986582-689b-406f-b369-ab3398699adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1418ec9d-ef8d-406e-bc69-10b7056cee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1418ec9d-ef8d-406e-bc69-10b7056cee29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-584639280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0987a8a9-e48d-4f82-9007-023c0eeb5902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a591ed4e584ccabb6bc780b61e04a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:45Z,use_quota=True,user_id='6ba8b2b5699e470b9b705e5d82b6584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b57a5a0-2482-47b0-82b1-4da89eb4520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b57a5a0-2482-47b0-82b1-4da89eb4520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90135538-3e26-46da-bf27-624fc5c12c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90135538-3e26-46da-bf27-624fc5c12c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0987a8a9-e48d-4f82-9007-023c0eeb5902', 'volume_name': 'volume-0987a8a9-e48d-4f82-9007-023c0eeb5902', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d20f1f8-bf7a-4e9f-8e2d-6e15aa55e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d20f1f8-bf7a-4e9f-8e2d-6e15aa55e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9015788a-cae1-41d4-b183-d842e024d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Volume 0987a8a9-e48d-4f82-9007-023c0eeb5902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0987a8a9-e48d-4f82-9007-023c0eeb5902', 'volume_size': 1} Jul 08 11:21:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:46 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 1G" returned: 0 in 1.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:46 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:21:46 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:47 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 1.079s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:47 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 is being set with open permissions: ugo+rw Jul 08 11:21:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:47 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:21:47 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:48 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 1.205s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:48 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info Jul 08 11:21:48 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:49 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info" returned: 0 in 1.124s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:49 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info is being set with open permissions: ugo+rw Jul 08 11:21:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:49 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info Jul 08 11:21:49 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:50 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.info" returned: 0 in 0.930s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.952s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.975s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-584639280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0987a8a9-e48d-4f82-9007-023c0eeb5902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a591ed4e584ccabb6bc780b61e04a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:45Z,use_quota=True,user_id='6ba8b2b5699e470b9b705e5d82b6584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Creating volume 0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:50 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:50 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 1073741824 Jul 08 11:21:50 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8c30560d-5d77-4b95-91e4-b76a4ccbc11d tempest-VolumesDeleteCascade-403727686 None] Create snapshot completed successfully Jul 08 11:21:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:51 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 1073741824" returned: 0 in 1.136s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:51 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:21:51 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:52 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:21:52 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:52 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 1.075s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.294s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Creating offline snapshot 0ade3b03-0917-4ddc-9fb7-e7765971aec3 of volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9015788a-cae1-41d4-b183-d842e024d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0987a8a9-e48d-4f82-9007-023c0eeb5902', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c912ae-f414-4f3a-910f-39d0dbb7db76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191f25f-b592-4d7c-8156-24adeb520156]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:52 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Volume volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 (0987a8a9-e48d-4f82-9007-023c0eeb5902): created successfully Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c912ae-f414-4f3a-910f-39d0dbb7db76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Flow 'volume_create_manager' (fd986582-689b-406f-b369-ab3398699adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c69b653b-6f3e-4a7d-bdff-624cceebe9da tempest-VolumesActionsTest-1327161890 None] Created volume successfully. Jul 08 11:21:53 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:21:53 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:53 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.945s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:21:53 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 1.141s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:21:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:54 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 1G Jul 08 11:21:54 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:55 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 1G" returned: 0 in 1.312s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:55 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 Jul 08 11:21:55 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:56 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:56 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 is being set with open permissions: ugo+rw Jul 08 11:21:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:56 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 Jul 08 11:21:56 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:56 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3" returned: 0 in 0.680s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.081s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f92c47f4-c30b-40aa-8665-a5de0021328f tempest-VolumesDeleteCascade-403727686 None] Create snapshot completed successfully Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Flow 'volume_create_manager' (15fcbbb9-a2b9-4c0e-a9e5-bdf88538eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf2ce4-f9a3-495c-a04a-07f0671be389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bf2ce4-f9a3-495c-a04a-07f0671be389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-370981775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6878fe0f-1e00-4c46-bbab-a69fade72577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec9852e402e46beb94d5952236ec1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:57Z,use_quota=True,user_id='0cd2b4f65db74ffcaeae36ec23253f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff696366-e058-4cc1-909b-65605d698bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff696366-e058-4cc1-909b-65605d698bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133075c4-9b77-4e76-b469-ede2125a5d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133075c4-9b77-4e76-b469-ede2125a5d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6878fe0f-1e00-4c46-bbab-a69fade72577', 'volume_name': 'volume-6878fe0f-1e00-4c46-bbab-a69fade72577', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5292e22-be27-4920-8f2e-db9f1bf77552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5292e22-be27-4920-8f2e-db9f1bf77552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec10dc-eda4-4074-8774-55d9c86b94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:21:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Volume 6878fe0f-1e00-4c46-bbab-a69fade72577: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6878fe0f-1e00-4c46-bbab-a69fade72577', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Trying to clone 6878fe0f-1e00-4c46-bbab-a69fade72577 from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-d076bfba-c08e-41ef-8298-8f09cfe8f1f6-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-d076bfba-c08e-41ef-8298-8f09cfe8f1f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Performing cascade delete. {{(pid=86852) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-0ade3b03-0917-4ddc-9fb7-e7765971aec3-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-0ade3b03-0917-4ddc-9fb7-e7765971aec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-0ade3b03-0917-4ddc-9fb7-e7765971aec3" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-0ade3b03-0917-4ddc-9fb7-e7765971aec3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Deleting offline snapshot 0ade3b03-0917-4ddc-9fb7-e7765971aec3 of volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] snapshot_file for this snap is: volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569d987-6649-4f50-9761-98079f23571c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:21:58 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Image download 20.69 MB at 20.69 MB/s Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe99a0-8271-4856-91c5-61a070809dfe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:58 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 Jul 08 11:21:58 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:58 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD Jul 08 11:21:58 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:58 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3" returned: 0 in 0.781s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[636cfd53-0bab-479f-bf5b-167347a0e0ca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:59 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 is fetched for user 0cd2b4f65db74ffcaeae36ec23253f70. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:21:59 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:21:59 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bb770-6044-43ff-ab46-1c681cf8629c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:59 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD Jul 08 11:21:59 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:59 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 0.912s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:21:59 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 Jul 08 11:21:59 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:21:59 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-370981775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6878fe0f-1e00-4c46-bbab-a69fade72577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec9852e402e46beb94d5952236ec1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:21:57Z,use_quota=True,user_id='0cd2b4f65db74ffcaeae36ec23253f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Creating volume 6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:21:59 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:21:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:00 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1073741824 Jul 08 11:22:00 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:00 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3" returned: 0 in 0.940s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:00 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3 Jul 08 11:22:00 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:00 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1073741824" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:01 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:01 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:01 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.0ade3b03-0917-4ddc-9fb7-e7765971aec3" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-0ade3b03-0917-4ddc-9fb7-e7765971aec3" released by "_delete_snapshot" :: held 3.544s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" released by "delete_snapshot" :: held 3.585s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Created reservations ['2dafe28d-672b-4f65-9f6a-0cc297adcb06', '37a6bc15-6ab5-4a15-bdf8-4098fea72ffd', '6ef1d59b-043e-4af4-8488-3da7fa73ae77', 'b7fcea7b-fd92-4530-b71f-2597296c0a22'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:01 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Delete snapshot completed successfully. Jul 08 11:22:01 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-0ade3b03-0917-4ddc-9fb7-e7765971aec3-delete_snapshot" released by "delete_snapshot" :: held 3.798s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-fbd17983-6b24-4aa8-b823-acd3a39097e3-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 0.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-fbd17983-6b24-4aa8-b823-acd3a39097e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Attempting download of 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 6878fe0f-1e00-4c46-bbab-a69fade72577. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-fbd17983-6b24-4aa8-b823-acd3a39097e3" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-fbd17983-6b24-4aa8-b823-acd3a39097e3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Deleting offline snapshot fbd17983-6b24-4aa8-b823-acd3a39097e3 of volume d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] snapshot_file for this snap is: volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d14e5-f057-4aca-9e9d-be1f10a223b1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997beff-f9cf-4496-b774-2b97a5185dcd]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:01 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:22:01 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:02 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic Jul 08 11:22:02 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:02 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:22:02 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic" returned: 0 in 0.822s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96943a-7c41-440e-b5e8-876b5d04e0ea]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:02 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 Jul 08 11:22:02 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:02 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic Jul 08 11:22:02 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:03 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic" returned: 1 in 1.008s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_ausyxfic' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[144d8cc3-9455-4d63-955f-ff581e829d0c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:03 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" returned: 0 in 1.138s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:03 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD Jul 08 11:22:03 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:03 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:22:03 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:04 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:04 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] 9c13436c-39fd-4e1e-9478-9ae05ec64994 was qcow2, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:22:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:04 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:04 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:04 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 0.852s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:04 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3 Jul 08 11:22:04 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:05 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6.fbd17983-6b24-4aa8-b823-acd3a39097e3" returned: 0 in 0.841s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-fbd17983-6b24-4aa8-b823-acd3a39097e3" released by "_delete_snapshot" :: held 3.780s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" released by "delete_snapshot" :: held 3.802s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Created reservations ['e488a656-a5b8-4fc9-81d2-c098535ce4c9', 'efc12ffc-a976-4437-b5eb-a55710d2b083', 'a493d30b-3f51-4783-a737-5f16baa90682', '5d15553a-ff74-4c9b-97d8-ba481e354a2b'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Delete snapshot completed successfully. Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-fbd17983-6b24-4aa8-b823-acd3a39097e3-delete_snapshot" released by "delete_snapshot" :: held 4.004s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Snapshots deleted, issuing volume delete {{(pid=86852) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd0b73e-343a-4790-8177-efb7552d0ae0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:06 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 Jul 08 11:22:06 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:06 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" returned: 0 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:06 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6 Jul 08 11:22:06 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:06 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 2.278s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:06 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_4p5_nb3bdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:22:06 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Converted 112.00 MB image at 49.13 MB/s Jul 08 11:22:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:06 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1G Jul 08 11:22:06 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:07 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" returned: 0 in 0.716s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-d076bfba-c08e-41ef-8298-8f09cfe8f1f6" released by "delete_volume" :: held 1.730s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Created reservations ['07a54410-09e2-4f88-bf7d-a9c9b2cfdc35', '6347f35b-daa8-42ac-bee7-8bd046d21c77', 'f2beb19b-a728-4520-9ab9-8d841360653f', 'fd55fd4a-96d8-4656-905d-7a8f125f3166'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:07 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 1G" returned: 0 in 0.801s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:07 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:22:07 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36f6e0-3b3e-4be1-bd90-a47e0e6cd55f]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:07 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:07 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:08 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.978s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:22:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Deleted volume successfully. Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3501f436-a884-48d8-8a40-0e47d413801f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-d076bfba-c08e-41ef-8298-8f09cfe8f1f6-delete_volume" released by "delete_volume" :: held 10.891s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (b898384d-9834-4a77-81a7-a183099f6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c66687-342e-4866-91b0-732d5e9a8385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c66687-342e-4866-91b0-732d5e9a8385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2055689190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d07723-d4c7-4d16-8024-1cfa77916da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeefe1e43264e8bb4913fb4be8cf071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:22:09Z,use_quota=True,user_id='724b976eed004485a2c005f56ea2d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c9116-f528-4dc4-8b30-389503e91e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c9116-f528-4dc4-8b30-389503e91e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79a779d-1192-4cdd-84cb-4326c1e39558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79a779d-1192-4cdd-84cb-4326c1e39558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d07723-d4c7-4d16-8024-1cfa77916da9', 'volume_name': 'volume-c8d07723-d4c7-4d16-8024-1cfa77916da9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:08 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b504cf-8bb7-4d90-820d-a285c7064175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b504cf-8bb7-4d90-820d-a285c7064175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a194e08-7acb-4e3e-ba87-dfe19c923c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Volume c8d07723-d4c7-4d16-8024-1cfa77916da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d07723-d4c7-4d16-8024-1cfa77916da9', 'volume_size': 1} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2055689190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d07723-d4c7-4d16-8024-1cfa77916da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeefe1e43264e8bb4913fb4be8cf071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:22:09Z,use_quota=True,user_id='724b976eed004485a2c005f56ea2d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Creating volume c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:22:08 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 1.171s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:08 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 1073741824 Jul 08 11:22:08 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:09 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:09 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:10 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 1 in 1.250s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Downloaded image 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 6878fe0f-1e00-4c46-bbab-a69fade72577 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 for user 0cd2b4f65db74ffcaeae36ec23253f70 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Marking volume 6878fe0f-1e00-4c46-bbab-a69fade72577 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:22:10 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 1073741824" returned: 0 in 1.310s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Copying metadata from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 to 6878fe0f-1e00-4c46-bbab-a69fade72577. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Creating volume glance metadata for volume 6878fe0f-1e00-4c46-bbab-a69fade72577 backed by image 9c13436c-39fd-4e1e-9478-9ae05ec64994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:10 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:10 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec10dc-eda4-4074-8774-55d9c86b94e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6878fe0f-1e00-4c46-bbab-a69fade72577', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6b637-d4e4-4afb-82b3-f4da4bbe25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Volume volume-6878fe0f-1e00-4c46-bbab-a69fade72577 (6878fe0f-1e00-4c46-bbab-a69fade72577): created successfully Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6b637-d4e4-4afb-82b3-f4da4bbe25ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Flow 'volume_create_manager' (15fcbbb9-a2b9-4c0e-a9e5-bdf88538eecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:22:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7445f9de-5280-4745-b6a2-9cfaa771873d tempest-TestShelveInstance-1145778754 None] Created volume successfully. Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-49ad5d26-f36d-4fff-a5ad-017ec43bf87f tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" by "attach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-49ad5d26-f36d-4fff-a5ad-017ec43bf87f tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" acquired by "attach_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-49ad5d26-f36d-4fff-a5ad-017ec43bf87f tempest-VolumesActionsTest-1327161890 None] Attaching volume 0987a8a9-e48d-4f82-9007-023c0eeb5902 to instance 65f375f7-b473-4e29-bf3c-1cf58517aa51 at mountpoint /dev/vdb on host None. Jul 08 11:22:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-49ad5d26-f36d-4fff-a5ad-017ec43bf87f tempest-VolumesActionsTest-1327161890 None] Attach volume completed successfully. Jul 08 11:22:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-49ad5d26-f36d-4fff-a5ad-017ec43bf87f tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" released by "attach_volume" :: held 0.094s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:11 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a194e08-7acb-4e3e-ba87-dfe19c923c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d07723-d4c7-4d16-8024-1cfa77916da9', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5804d1-3455-43eb-8539-16847d3d8fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Volume volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 (c8d07723-d4c7-4d16-8024-1cfa77916da9): created successfully Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5804d1-3455-43eb-8539-16847d3d8fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (b898384d-9834-4a77-81a7-a183099f6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:22:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bc1e864c-33ee-4b3c-8409-5d4daa3e25da tempest-VolumesDeleteCascade-403727686 None] Created volume successfully. Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e44481cf-0905-4324-a5ed-7a921005b69f tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" by "detach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e44481cf-0905-4324-a5ed-7a921005b69f tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e44481cf-0905-4324-a5ed-7a921005b69f tempest-VolumesActionsTest-1327161890 None] Detaching volume 0987a8a9-e48d-4f82-9007-023c0eeb5902 from instance 65f375f7-b473-4e29-bf3c-1cf58517aa51. Jul 08 11:22:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e44481cf-0905-4324-a5ed-7a921005b69f tempest-VolumesActionsTest-1327161890 None] Detach volume completed successfully. Jul 08 11:22:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e44481cf-0905-4324-a5ed-7a921005b69f tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Creating offline snapshot 637f5488-2cdf-4f4d-aa5a-2b9b634fb464 of volume c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:22:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a673835-469c-4256-82a5-4345b61ea025]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:12 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:12 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:13 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 1.379s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:13 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 1G Jul 08 11:22:13 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:15 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 1G" returned: 0 in 1.146s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:15 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:15 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:15 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 0.772s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:15 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 is being set with open permissions: ugo+rw Jul 08 11:22:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:15 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:15 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:16 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:16 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info Jul 08 11:22:16 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:17 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info" returned: 0 in 0.659s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:17 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info is being set with open permissions: ugo+rw Jul 08 11:22:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:17 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info Jul 08 11:22:17 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:17 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.info" returned: 0 in 0.621s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.399s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:17 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dd49ff36-bc99-4deb-b417-bc8d9e31296d tempest-VolumesDeleteCascade-403727686 None] Create snapshot completed successfully Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (a2602ccf-ef1e-4564-968d-4f786c0546a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b5214c-970c-4e8e-9eca-f84f099ee14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b5214c-970c-4e8e-9eca-f84f099ee14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2036418667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd1fdf9-6eff-4033-b9ad-742064149d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeefe1e43264e8bb4913fb4be8cf071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=637f5488-2cdf-4f4d-aa5a-2b9b634fb464,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:22:19Z,use_quota=True,user_id='724b976eed004485a2c005f56ea2d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adaa7d7-4457-4830-9858-91dac610ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adaa7d7-4457-4830-9858-91dac610ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c420c403-ef94-4641-b606-6b00ef10cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c420c403-ef94-4641-b606-6b00ef10cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fd1fdf9-6eff-4033-b9ad-742064149d41', 'volume_name': 'volume-7fd1fdf9-6eff-4033-b9ad-742064149d41', 'volume_size': 1, 'snapshot_id': '637f5488-2cdf-4f4d-aa5a-2b9b634fb464'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8563eb77-287d-4b00-9f8f-33fe497ae2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8563eb77-287d-4b00-9f8f-33fe497ae2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4087f4ed-e20f-4165-a813-d43050b22612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Volume 7fd1fdf9-6eff-4033-b9ad-742064149d41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fd1fdf9-6eff-4033-b9ad-742064149d41', 'volume_size': 1, 'snapshot_id': '637f5488-2cdf-4f4d-aa5a-2b9b634fb464'} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-7fd1fdf9-6eff-4033-b9ad-742064149d41" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-7fd1fdf9-6eff-4033-b9ad-742064149d41" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Creating volume 7fd1fdf9-6eff-4033-b9ad-742064149d41 from snapshot 637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] snapshot: 637f5488-2cdf-4f4d-aa5a-2b9b634fb464, volume: 7fd1fdf9-6eff-4033-b9ad-742064149d41, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b89a0d-13b9-4a26-b55b-f26c7919a260]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:19 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:19 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:20 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 0.905s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8d07723-d4c7-4d16-8024-1cfa77916da9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3d739-390c-4a28-b9e5-20e7e0adbe98]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:20 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:20 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-0cd06fd0-9d24-44ab-9fcc-1a70af38fe44 req-0906ea57-0b1e-469d-b36e-56ae9441a920 tempest-AttachVolumeNegativeTest-1942800585 None] Terminate volume connection completed successfully. Jul 08 11:22:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-0cd06fd0-9d24-44ab-9fcc-1a70af38fe44 req-0906ea57-0b1e-469d-b36e-56ae9441a920 tempest-AttachVolumeNegativeTest-1942800585 None] Deleting attachment ed11c5ad-8956-4eee-a3ec-4a183a34e424. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:22:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:21 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 1.012s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:21 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:22:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:21 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 Jul 08 11:22:21 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:27 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41" returned: 0 in 6.533s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:27 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35a540-e277-4104-9476-304eb4b73f7f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:28 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:28 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:28 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 1.034s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:28 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:22:28 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Converted 1024.00 MB image at 156.71 MB/s Jul 08 11:22:28 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 is being set with open permissions: ugo+rw Jul 08 11:22:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:29 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 Jul 08 11:22:29 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:29 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" released by "_copy_volume_from_snapshot" :: held 10.314s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-7fd1fdf9-6eff-4033-b9ad-742064149d41" released by "_create_volume_from_snapshot" :: held 10.351s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.368s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.364s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4087f4ed-e20f-4165-a813-d43050b22612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd1fdf9-6eff-4033-b9ad-742064149d41', 'volume_size': 1, 'snapshot_id': '637f5488-2cdf-4f4d-aa5a-2b9b634fb464'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952ee54-91f0-402d-a971-1d80618f6b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605c572-ecbb-4ac0-b464-b8f3c3a29f76]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Volume volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 (7fd1fdf9-6eff-4033-b9ad-742064149d41): created successfully Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6952ee54-91f0-402d-a971-1d80618f6b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:22:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Flow 'volume_create_manager' (a2602ccf-ef1e-4564-968d-4f786c0546a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:22:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7fcb0626-fb00-41f1-ba5b-1c6b1d33ff4f tempest-VolumesDeleteCascade-403727686 None] Created volume successfully. Jul 08 11:22:29 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:29 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-c8d07723-d4c7-4d16-8024-1cfa77916da9-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-c8d07723-d4c7-4d16-8024-1cfa77916da9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:30 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Performing cascade delete. {{(pid=86852) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 0.965s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Deleting offline snapshot 637f5488-2cdf-4f4d-aa5a-2b9b634fb464 of volume c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] snapshot_file for this snap is: volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e2863-f34c-4122-8d09-5e7bf5e5825c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:30 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:22:30 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:30 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:30 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:31 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 1 in 0.931s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.956s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-6878fe0f-1e00-4c46-bbab-a69fade72577', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '861f3e65-0cca-48f1-99a1-9bd7bc86fdec', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:22:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-d33de124-9ee2-4bbc-a4ad-4278a161a318 req-e9df4623-f45e-4c7d-9ac7-a4d9b7ef3b66 tempest-TestShelveInstance-1145778754 None] attachment_update completed successfully. Jul 08 11:22:31 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 1.144s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8d07723-d4c7-4d16-8024-1cfa77916da9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:22:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b077a1-7311-495f-9924-7d0e39907113]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:32 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:32 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:32 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:32 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:32 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:33 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 0.794s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:33 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464 Jul 08 11:22:33 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:34 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9.637f5488-2cdf-4f4d-aa5a-2b9b634fb464" returned: 0 in 0.744s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-637f5488-2cdf-4f4d-aa5a-2b9b634fb464" released by "_delete_snapshot" :: held 3.622s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" released by "delete_snapshot" :: held 3.660s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Created reservations ['7ab79d2f-04ae-428c-94e4-f1d0659c06e9', '42f97efc-3dc8-4eaa-a124-72c09d009071', '2572be9f-20ee-452f-aafb-a7d24f013bc6', '41739f4e-d7b4-4348-beea-51d53a5bbf01'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Delete snapshot completed successfully. Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-637f5488-2cdf-4f4d-aa5a-2b9b634fb464-delete_snapshot" released by "delete_snapshot" :: held 3.869s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Snapshots deleted, issuing volume delete {{(pid=86852) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68811c1-d6c3-4cba-961f-7f065066e673]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:34 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:34 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:35 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 1.093s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:35 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9 Jul 08 11:22:35 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:36 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8d07723-d4c7-4d16-8024-1cfa77916da9" returned: 0 in 1.213s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-c8d07723-d4c7-4d16-8024-1cfa77916da9" released by "delete_volume" :: held 2.389s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=68,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=20 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=53,cinder:SELECT=60,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Created reservations ['0df01cdd-06e6-4d6f-a5b8-66a61a566591', '35455f66-4821-47ee-82cb-b90648823d51', '7a5ac742-13ec-4579-86cf-3a3b0a725dfc', 'd11fa6a1-0eef-4af6-adbc-f704a73e44d2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:37 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:22:37 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-7fd1fdf9-6eff-4033-b9ad-742064149d41-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-7fd1fdf9-6eff-4033-b9ad-742064149d41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[32288e6a-d2a6-459b-9e2f-ff129d7c2570]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:38 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 Jul 08 11:22:38 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:38 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.252s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:38 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:22:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Deleted volume successfully. Jul 08 11:22:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dfc131e-9848-405c-80f6-51bc30bcb4bd tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-c8d07723-d4c7-4d16-8024-1cfa77916da9-delete_volume" released by "delete_volume" :: held 7.929s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:38 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41" returned: 0 in 1.056s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:39 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41 Jul 08 11:22:39 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:40 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-7fd1fdf9-6eff-4033-b9ad-742064149d41" returned: 0 in 1.171s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-quobyte-7fd1fdf9-6eff-4033-b9ad-742064149d41" released by "delete_volume" :: held 2.302s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Created reservations ['5dbf0f4c-155a-4495-99ce-6f670ce88e1e', '407635f7-a02f-456b-be0a-02e32303d8ae', '0aecb1cd-3939-4006-8ad5-8a4d785fbf04', '8b6da557-d1ba-470b-bed1-03f1253cbe29'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:40 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:22:40 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dffe68b2-bbd5-471f-ab2e-64f234863aed tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" by "attach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dffe68b2-bbd5-471f-ab2e-64f234863aed tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" acquired by "attach_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dffe68b2-bbd5-471f-ab2e-64f234863aed tempest-VolumesActionsTest-1327161890 None] Attaching volume 0987a8a9-e48d-4f82-9007-023c0eeb5902 to instance 7c7127e3-5e01-44b5-bec5-12a5fdb201d4 at mountpoint /dev/vdb on host None. Jul 08 11:22:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dffe68b2-bbd5-471f-ab2e-64f234863aed tempest-VolumesActionsTest-1327161890 None] Attach volume completed successfully. Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dffe68b2-bbd5-471f-ab2e-64f234863aed tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902" released by "attach_volume" :: held 0.135s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:41 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.166s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:22:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Deleted volume successfully. Jul 08 11:22:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-066db591-b718-48cf-8e74-d302174bb128 tempest-VolumesDeleteCascade-403727686 None] Lock "cinder-7fd1fdf9-6eff-4033-b9ad-742064149d41-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b3b77a4-2c10-44fb-aa72-fbffa08f9047 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" by "detach_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:22:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b3b77a4-2c10-44fb-aa72-fbffa08f9047 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:22:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7b3b77a4-2c10-44fb-aa72-fbffa08f9047 tempest-VolumesActionsTest-1327161890 None] Detaching volume 0987a8a9-e48d-4f82-9007-023c0eeb5902 from instance 7c7127e3-5e01-44b5-bec5-12a5fdb201d4. Jul 08 11:22:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7b3b77a4-2c10-44fb-aa72-fbffa08f9047 tempest-VolumesActionsTest-1327161890 None] Detach volume completed successfully. Jul 08 11:22:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b3b77a4-2c10-44fb-aa72-fbffa08f9047 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:22:52 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:22:52 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:22:52 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:53 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.121s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:22:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:22:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:22:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:22:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:22:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:22:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea661a-2646-4cc1-9898-cc903d5183a6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:55 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:22:55 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:56 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 1.600s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ccd99-75a8-427b-a227-76a1b1113f70]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:22:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:56 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:22:56 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:22:58 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 08 11:22:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 1.388s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:22:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.cbf4ac2d-6497-47df-8b33-806fc1a98ca59wah609i.img {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:22:58 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.cbf4ac2d-6497-47df-8b33-806fc1a98ca59wah609i.img Jul 08 11:22:58 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:23:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (a66a2ad6-8468-48c5-b36b-0b175d55fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e6c665-a74b-4960-abd7-1bd212a75029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e6c665-a74b-4960-abd7-1bd212a75029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-783324142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3627c540-1e30-43a6-9861-2e6e659f4c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:05Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ee2eaa-26e2-4925-a31f-9200a0a62b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ee2eaa-26e2-4925-a31f-9200a0a62b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609039e7-953a-4c11-91b9-9a1f756ef0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609039e7-953a-4c11-91b9-9a1f756ef0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3627c540-1e30-43a6-9861-2e6e659f4c13', 'volume_name': 'volume-3627c540-1e30-43a6-9861-2e6e659f4c13', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0690b7-06bc-4c08-91c7-9570014c681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0690b7-06bc-4c08-91c7-9570014c681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba576a-bd1d-413b-9ba9-be6952bfdc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume 3627c540-1e30-43a6-9861-2e6e659f4c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3627c540-1e30-43a6-9861-2e6e659f4c13', 'volume_size': 1} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:05 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.cbf4ac2d-6497-47df-8b33-806fc1a98ca59wah609i.img" returned: 0 in 7.358s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2c5ef2-57be-4102-952b-22b50e66cfbf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:05 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:05 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:06 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 1.256s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:06 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.cbf4ac2d-6497-47df-8b33-806fc1a98ca59wah609i.img {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:23:06 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Converted 1024.00 MB image at 139.09 MB/s Jul 08 11:23:06 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] cbf4ac2d-6497-47df-8b33-806fc1a98ca5 was raw, no need to convert to raw {{(pid=86852) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 11:23:13 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-2e0e8e86-cbeb-4343-bfd5-bf22e1b070ec req-a40dd096-f3fa-4762-a185-a8a841d800df tempest-TestShelveInstance-1145778754 None] Terminate volume connection completed successfully. Jul 08 11:23:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-2e0e8e86-cbeb-4343-bfd5-bf22e1b070ec req-a40dd096-f3fa-4762-a185-a8a841d800df tempest-TestShelveInstance-1145778754 None] Deleting attachment 861f3e65-0cca-48f1-99a1-9bd7bc86fdec. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (2f5ddb34-7634-4ca8-a15b-6d75921d4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c537a-743e-4161-8f26-fb261c2b57a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c537a-743e-4161-8f26-fb261c2b57a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1932557071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1b0ff-2006-4dec-a98c-e72164753074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:18Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d32626-40b6-4442-b0ce-43e778b60c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d32626-40b6-4442-b0ce-43e778b60c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f5016-e71e-4592-be77-d387540bf208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225f5016-e71e-4592-be77-d387540bf208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e1b0ff-2006-4dec-a98c-e72164753074', 'volume_name': 'volume-c1e1b0ff-2006-4dec-a98c-e72164753074', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141fba1e-6cff-4ed3-bed9-cce1c0c42366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141fba1e-6cff-4ed3-bed9-cce1c0c42366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ac1e7-8cd1-4bfc-bed7-573ed3338fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:17 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Volume c1e1b0ff-2006-4dec-a98c-e72164753074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e1b0ff-2006-4dec-a98c-e72164753074', 'volume_size': 1} Jul 08 11:23:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:27 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.128s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Uploaded volume to glance image-id: cbf4ac2d-6497-47df-8b33-806fc1a98ca5. {{(pid=86852) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.156s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-783324142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3627c540-1e30-43a6-9861-2e6e659f4c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:05Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating volume 3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:23:28 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:23:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:28 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 1073741824 Jul 08 11:23:28 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a947153e-1759-47c3-ba29-6ad821f87ab3 tempest-VolumesActionsTest-1327161890 None] Copy volume to image completed successfully. Jul 08 11:23:29 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 1073741824" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:29 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 Jul 08 11:23:29 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:29 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13" returned: 0 in 0.665s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.079s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1932557071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1b0ff-2006-4dec-a98c-e72164753074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:18Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Creating volume c1e1b0ff-2006-4dec-a98c-e72164753074 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:23:29 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:29 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 1073741824 Jul 08 11:23:29 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ba576a-bd1d-413b-9ba9-be6952bfdc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3627c540-1e30-43a6-9861-2e6e659f4c13', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8343e667-4566-4309-a49f-986c484df02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume volume-3627c540-1e30-43a6-9861-2e6e659f4c13 (3627c540-1e30-43a6-9861-2e6e659f4c13): created successfully Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8343e667-4566-4309-a49f-986c484df02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (a66a2ad6-8468-48c5-b36b-0b175d55fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e366d30f-b00f-4fef-97d5-660415593a58 tempest-VolumesSnapshotTestJSON-1663763165 None] Created volume successfully. Jul 08 11:23:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:30 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 1073741824" returned: 0 in 0.881s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:30 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 Jul 08 11:23:30 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:31 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074" returned: 0 in 0.642s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.199s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ac1e7-8cd1-4bfc-bed7-573ed3338fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e1b0ff-2006-4dec-a98c-e72164753074', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c2e0e9-245b-48af-be6b-06f14860d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Volume volume-c1e1b0ff-2006-4dec-a98c-e72164753074 (c1e1b0ff-2006-4dec-a98c-e72164753074): created successfully Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c2e0e9-245b-48af-be6b-06f14860d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (2f5ddb34-7634-4ca8-a15b-6d75921d4484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dda294-dee8-482b-b646-4ba432503de5]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d6469f82-ad95-4656-ad48-1dfc2f840949 tempest-AttachVolumeNegativeTest-1942800585 None] Created volume successfully. Jul 08 11:23:31 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:23:31 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:32 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 0.766s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:32 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:23:32 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:32 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 1 in 0.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.596s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.782s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eec12a-4240-453c-a0a4-6fd4cbde736b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-6878fe0f-1e00-4c46-bbab-a69fade72577', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff78316f-f340-4c9e-897e-dc1baf6ff791', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:23:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-87f324d8-1c4a-4de7-903d-cfd82a6fe7ae req-570b62c8-37f4-48dc-99df-0d8fed4e3ae0 tempest-TestShelveInstance-1145778754 None] attachment_update completed successfully. Jul 08 11:23:33 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:33 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:33 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b646b4b-ed2f-422b-9147-f626b5a460ff]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:33 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:33 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:34 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 0.810s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:34 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img Jul 08 11:23:34 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:39 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img" returned: 0 in 4.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f6e32-146d-4718-b9e7-54840b36d2ef]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:39 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:39 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:40 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 0.976s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:40 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:23:40 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Converted 1024.00 MB image at 211.70 MB/s Jul 08 11:23:40 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] 1f15bff7-56a8-4a98-b77b-0f41af903781 was raw, converting to qcow2 {{(pid=86852) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 11:23:40 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312e7e1-bf0a-4ebd-b4f6-1dced4ea121a]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:40 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img Jul 08 11:23:40 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:41 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img" returned: 0 in 0.749s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:41 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img Jul 08 11:23:41 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:41 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img" returned: 1 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:23:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img /opt/stack/data/cinder/conversion/vol_upload_h322gega {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:42 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img /opt/stack/data/cinder/conversion/vol_upload_h322gega Jul 08 11:23:42 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:42 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img /opt/stack/data/cinder/conversion/vol_upload_h322gega" returned: 0 in 0.729s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:42 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Image conversion details: src /opt/stack/data/cinder/conversion/0987a8a9-e48d-4f82-9007-023c0eeb5902.temp_image.1f15bff7-56a8-4a98-b77b-0f41af903781cgpclo2n.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h322gega {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:23:42 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 11:23:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424ba2d-57cc-453d-a31e-a5b998ed9472]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h322gega {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:42 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h322gega Jul 08 11:23:42 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:43 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h322gega" returned: 0 in 0.968s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.115s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Uploaded volume to glance image-id: 1f15bff7-56a8-4a98-b77b-0f41af903781. {{(pid=86852) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.331s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating offline snapshot 5934d26a-36bf-4a95-82c2-015683c7cdfb of volume 3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:23:45 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8ef7366e-1340-4541-9b74-4b4b86798a50 tempest-VolumesActionsTest-1327161890 None] Copy volume to image completed successfully. Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0639cd-30c0-4a45-b1df-0d7c2057a187]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:45 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 Jul 08 11:23:45 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:45 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13" returned: 0 in 0.864s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:46 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb 1G Jul 08 11:23:46 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "cinder-quobyte-0987a8a9-e48d-4f82-9007-023c0eeb5902" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-quobyte-0987a8a9-e48d-4f82-9007-023c0eeb5902" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[93415c3a-6622-4030-b969-40531d2bca7b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:46 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:46 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:47 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb 1G" returned: 0 in 1.046s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3627c540-1e30-43a6-9861-2e6e659f4c13 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:47 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3627c540-1e30-43a6-9861-2e6e659f4c13 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb Jul 08 11:23:47 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:47 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 0.922s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:47 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902 Jul 08 11:23:47 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:47 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3627c540-1e30-43a6-9861-2e6e659f4c13 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:47 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb is being set with open permissions: ugo+rw Jul 08 11:23:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:47 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb Jul 08 11:23:47 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:48 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0987a8a9-e48d-4f82-9007-023c0eeb5902" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-quobyte-0987a8a9-e48d-4f82-9007-023c0eeb5902" released by "delete_volume" :: held 1.696s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Created reservations ['f01bb685-f9f5-48f7-878c-28edd239373b', '75f21337-970a-4313-99de-f4ebf1c12c62', '21dea453-88f1-4547-ad46-f83bec698ef3', '8e7e9a39-c7a2-4d8c-82a0-b8f13c473fb2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:48 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb" returned: 0 in 0.756s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:48 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:23:48 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:48 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info Jul 08 11:23:48 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:49 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.823s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:49 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:23:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Deleted volume successfully. Jul 08 11:23:49 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info" returned: 0 in 0.783s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:49 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info is being set with open permissions: ugo+rw Jul 08 11:23:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ed89d46-1a07-46fb-a50b-9207ce7d1874 tempest-VolumesActionsTest-1327161890 None] Lock "cinder-0987a8a9-e48d-4f82-9007-023c0eeb5902-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:23:49 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info Jul 08 11:23:49 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:50 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.info" returned: 0 in 0.710s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.109s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.217s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c37b1-755a-4153-a2be-02282f7e184d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6e7b8139-8fcd-483d-9ea5-bd7640508544 tempest-VolumesSnapshotTestJSON-1663763165 None] Create snapshot completed successfully Jul 08 11:23:50 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 Jul 08 11:23:50 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-5934d26a-36bf-4a95-82c2-015683c7cdfb-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-5934d26a-36bf-4a95-82c2-015683c7cdfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-5934d26a-36bf-4a95-82c2-015683c7cdfb" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-5934d26a-36bf-4a95-82c2-015683c7cdfb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleting offline snapshot 5934d26a-36bf-4a95-82c2-015683c7cdfb of volume 3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] snapshot_file for this snap is: volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d64e4-6982-4e31-9fa7-025b5f70ec58]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:51 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb Jul 08 11:23:51 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:51 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074" returned: 0 in 1.050s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-c1e1b0ff-2006-4dec-a98c-e72164753074', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '595607e7-6df6-4955-b68f-333e14434c2b', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:23:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-dcb4d515-f089-4835-a966-44286e88ee45 req-addc7e7c-c9dd-4ef7-b8e8-52ba3aac2b38 tempest-AttachVolumeNegativeTest-1942800585 None] attachment_update completed successfully. Jul 08 11:23:51 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb" returned: 0 in 0.974s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3627c540-1e30-43a6-9861-2e6e659f4c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd360790-936c-4ac0-8eeb-94f2ff023082]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:51 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 Jul 08 11:23:51 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:52 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:23:52 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:52 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13" returned: 0 in 1.063s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:52 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb Jul 08 11:23:52 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:53 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.982s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:23:53 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb" returned: 0 in 0.908s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:53 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb Jul 08 11:23:53 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:54 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13.5934d26a-36bf-4a95-82c2-015683c7cdfb" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-5934d26a-36bf-4a95-82c2-015683c7cdfb" released by "_delete_snapshot" :: held 3.825s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:23:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" released by "delete_snapshot" :: held 3.874s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:23:54 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['a9d2c145-6967-4782-9a9f-a4ad679b4499', 'acd687d8-2adf-4b17-8f7b-b5318cf2e39d', 'c5a876ae-24b4-4f22-b428-c738c6cc547b', 'ef1f9c17-b510-42be-b84c-f711f92de792'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:23:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Delete snapshot completed successfully. Jul 08 11:23:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-09d96500-89c1-4268-bcef-7a5cf0468351 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-5934d26a-36bf-4a95-82c2-015683c7cdfb-delete_snapshot" released by "delete_snapshot" :: held 4.132s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (e5a6825a-a8cb-431b-8a7b-7b0382e1c581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1810c0-81cd-43d8-bb48-1de50ad84950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1810c0-81cd-43d8-bb48-1de50ad84950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1151109120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad20a866-90ff-4855-a2f9-38b3fd2baca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:56Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeed7ea-cef8-4239-99e5-1f1705b24960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceeed7ea-cef8-4239-99e5-1f1705b24960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0128dc1-cab5-4108-bddd-f70022070374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0128dc1-cab5-4108-bddd-f70022070374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad20a866-90ff-4855-a2f9-38b3fd2baca2', 'volume_name': 'volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a6dbc0-f4b6-40b1-b975-4853782cc521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a6dbc0-f4b6-40b1-b975-4853782cc521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c41c1b-bfca-424b-a46c-fa063d60982d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:55 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume ad20a866-90ff-4855-a2f9-38b3fd2baca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2', 'volume_size': 1} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1151109120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad20a866-90ff-4855-a2f9-38b3fd2baca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:56Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating volume ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:23:55 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:23:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:55 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 1073741824 Jul 08 11:23:55 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Flow 'volume_create_manager' (2b4b5ddb-0045-4c0c-a256-aaf9c5efb18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad0b5e1-ccd2-47f9-9689-e53e093eb78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad0b5e1-ccd2-47f9-9689-e53e093eb78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1703129057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aabe0b75144047b12f5c80bb2875bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:56Z,use_quota=True,user_id='85ea8f2df2de48a481d3f6c8baa6d962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3158b1-21b4-4a1e-8869-e48856a0aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3158b1-21b4-4a1e-8869-e48856a0aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a09f586-8b84-4f38-b455-616a79f0133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a09f586-8b84-4f38-b455-616a79f0133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'volume_name': 'volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e27835a-f5d0-48ce-8969-82719b093adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e27835a-f5d0-48ce-8969-82719b093adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f33be4e-8d97-4ce5-afb2-c5188b49ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Volume e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'volume_size': 1} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:56 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 1073741824" returned: 0 in 1.089s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:56 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:23:56 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:57 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 0.661s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1703129057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aabe0b75144047b12f5c80bb2875bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:23:56Z,use_quota=True,user_id='85ea8f2df2de48a481d3f6c8baa6d962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Creating volume e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:23:57 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c41c1b-bfca-424b-a46c-fa063d60982d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58ba7ec-29cc-4db9-9873-a7de99973700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:57 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb 1073741824 Jul 08 11:23:57 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 (ad20a866-90ff-4855-a2f9-38b3fd2baca2): created successfully Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58ba7ec-29cc-4db9-9873-a7de99973700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (e5a6825a-a8cb-431b-8a7b-7b0382e1c581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-09e6ef7c-079d-4743-a9da-e9f7ba5652e3 tempest-VolumesSnapshotTestJSON-1663763165 None] Created volume successfully. Jul 08 11:23:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:23:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-57d07f28-b3d8-459b-895e-8c88c79288ca req-857ba85a-fc06-4783-a9d6-e5a491e36ee1 tempest-AttachVolumeNegativeTest-1942800585 None] Terminate volume connection completed successfully. Jul 08 11:23:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-57d07f28-b3d8-459b-895e-8c88c79288ca req-857ba85a-fc06-4783-a9d6-e5a491e36ee1 tempest-AttachVolumeNegativeTest-1942800585 None] Deleting attachment 595607e7-6df6-4955-b68f-333e14434c2b. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:23:58 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb 1073741824" returned: 0 in 0.900s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:58 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:23:58 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:59 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 0.656s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.149s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Creating offline snapshot 89419e1d-b27e-4921-9d77-46892c7f9626 of volume ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f33be4e-8d97-4ce5-afb2-c5188b49ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db16745-1bee-4182-8128-f71a949ef71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51cb295-332c-4488-84f7-d74c140bcb4d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:59 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Volume volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb (e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb): created successfully Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db16745-1bee-4182-8128-f71a949ef71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Flow 'volume_create_manager' (2b4b5ddb-0045-4c0c-a256-aaf9c5efb18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:23:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3859388d-23ef-4f38-99c3-ced56978ff9f tempest-VolumesCloneTest-1938939820 None] Created volume successfully. Jul 08 11:23:59 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:23:59 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:23:59 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:23:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:23:59 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 1G Jul 08 11:23:59 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Flow 'volume_create_manager' (dfdd8419-cc27-486d-bd8d-54171771c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5eab92-0753-4587-9185-172effdfbae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5eab92-0753-4587-9185-172effdfbae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1177142908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf59100c-4e85-4d75-8a74-54a39a5e954c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aabe0b75144047b12f5c80bb2875bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:00Z,use_quota=True,user_id='85ea8f2df2de48a481d3f6c8baa6d962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9eb318-67eb-4b04-a080-501a8c5ceb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9eb318-67eb-4b04-a080-501a8c5ceb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22140ef-983f-4b36-bc7b-5bed82e6b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22140ef-983f-4b36-bc7b-5bed82e6b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf59100c-4e85-4d75-8a74-54a39a5e954c', 'volume_name': 'volume-cf59100c-4e85-4d75-8a74-54a39a5e954c', 'volume_size': 2, 'source_volid': 'e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'source_volstatus': 'available'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d68d1-8eef-449e-824e-f1bdf855a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d68d1-8eef-449e-824e-f1bdf855a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded65358-d9b9-4c9b-ae8e-5e3baf4c29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Volume cf59100c-4e85-4d75-8a74-54a39a5e954c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf59100c-4e85-4d75-8a74-54a39a5e954c', 'volume_size': 2, 'source_volid': 'e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'source_volstatus': 'available'} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:00 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 1G" returned: 0 in 0.979s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:00 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:00 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:01 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:01 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 is being set with open permissions: ugo+rw Jul 08 11:24:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:01 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:01 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:02 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:02 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info Jul 08 11:24:02 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:03 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info" returned: 0 in 0.697s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:03 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info is being set with open permissions: ugo+rw Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:03 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info Jul 08 11:24:03 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:03 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.info" returned: 0 in 0.687s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.748s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.405s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Cloning volume e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb to volume cf59100c-4e85-4d75-8a74-54a39a5e954c Jul 08 11:24:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-833c9d82-3ac4-44bc-88b2-60f77bfd061d tempest-VolumesSnapshotTestJSON-1663763165 None] Create snapshot completed successfully Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Creating offline snapshot e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 of volume e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1987ef1-2006-4b5b-83f9-a8d64c494fac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:03 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:03 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:04 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:04 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 1G Jul 08 11:24:04 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (474152bc-add8-4743-8465-d8540bff3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f25b21e-eb91-47eb-8126-e02f8f3993c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f25b21e-eb91-47eb-8126-e02f8f3993c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-320328222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25faee2-053a-4810-92ca-32ad7f7925ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=89419e1d-b27e-4921-9d77-46892c7f9626,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:05Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446910f2-7507-4761-b0a3-c94a8c52e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446910f2-7507-4761-b0a3-c94a8c52e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02c769c-cf9f-4140-9879-f49b8c4da188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02c769c-cf9f-4140-9879-f49b8c4da188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e25faee2-053a-4810-92ca-32ad7f7925ac', 'volume_name': 'volume-e25faee2-053a-4810-92ca-32ad7f7925ac', 'volume_size': 2, 'snapshot_id': '89419e1d-b27e-4921-9d77-46892c7f9626'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dae57a5-0049-464e-b592-f36fe6ec18eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dae57a5-0049-464e-b592-f36fe6ec18eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e21dd-0b28-4e7b-9f23-0d07df33dad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume e25faee2-053a-4810-92ca-32ad7f7925ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e25faee2-053a-4810-92ca-32ad7f7925ac', 'volume_size': 2, 'snapshot_id': '89419e1d-b27e-4921-9d77-46892c7f9626'} Jul 08 11:24:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:05 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 1G" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:05 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:05 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:06 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:06 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 is being set with open permissions: ugo+rw Jul 08 11:24:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:06 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:06 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:06 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:06 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info Jul 08 11:24:06 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:07 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:07 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info is being set with open permissions: ugo+rw Jul 08 11:24:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:07 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info Jul 08 11:24:07 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:08 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.info" returned: 0 in 0.715s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] snapshot: e0d5dbbc-f0d8-49e7-b976-b7da54984ea6, volume: cf59100c-4e85-4d75-8a74-54a39a5e954c, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec97c36-07cc-47d6-8ceb-1b4d726b067b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:08 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:08 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:09 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.895s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b8bde-2668-45c5-9c2b-78ab95049133]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:09 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:09 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:10 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 0.802s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:10 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:24:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:10 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c Jul 08 11:24:10 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:15 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c" returned: 0 in 5.149s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7a8f3a-e4da-4f16-a5a0-1ada1a48f301]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:15 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:15 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:16 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 0.918s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:24:16 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Converted 1024.00 MB image at 198.84 MB/s Jul 08 11:24:16 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c is being set with open permissions: ugo+rw Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:16 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c Jul 08 11:24:16 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:16 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c" returned: 0 in 0.627s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" released by "_copy_volume_from_snapshot" :: held 8.477s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-quobyte-e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Deleting offline snapshot e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 of volume e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] snapshot_file for this snap is: volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[15125342-8a88-4641-80f5-e68b936bb802]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:16 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=50,cinder:INSERT=12,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:24:16 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:16 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:17 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.765s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:24:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be481f-47c1-47e8-b866-bb5910ebc428]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:17 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:17 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:18 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:18 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:18 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:19 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:19 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6 Jul 08 11:24:19 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:19 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb.e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" returned: 0 in 0.775s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-e0d5dbbc-f0d8-49e7-b976-b7da54984ea6" released by "_delete_snapshot" :: held 3.139s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.202s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.156s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626-e25faee2-053a-4810-92ca-32ad7f7925ac" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded65358-d9b9-4c9b-ae8e-5e3baf4c29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf59100c-4e85-4d75-8a74-54a39a5e954c', 'volume_size': 2, 'source_volid': 'e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb', 'source_volstatus': 'available'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78198588-2816-4cee-a8f7-6a3c753fe74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626-e25faee2-053a-4810-92ca-32ad7f7925ac" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating volume e25faee2-053a-4810-92ca-32ad7f7925ac from snapshot 89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:20 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Volume volume-cf59100c-4e85-4d75-8a74-54a39a5e954c (cf59100c-4e85-4d75-8a74-54a39a5e954c): created successfully Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78198588-2816-4cee-a8f7-6a3c753fe74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Flow 'volume_create_manager' (dfdd8419-cc27-486d-bd8d-54171771c70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] snapshot: 89419e1d-b27e-4921-9d77-46892c7f9626, volume: e25faee2-053a-4810-92ca-32ad7f7925ac, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4c1bc916-52ca-40b2-8fb7-9692f8b6ec21 tempest-VolumesCloneTest-1938939820 None] Created volume successfully. Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c769a-9736-4907-ba93-7bf5420050c9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:20 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:20 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-cf59100c-4e85-4d75-8a74-54a39a5e954c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-cf59100c-4e85-4d75-8a74-54a39a5e954c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5217ea-0f87-4f0e-bab6-5d47ec33a15e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:20 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c Jul 08 11:24:20 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:20 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 0.823s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:24:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[16acb868-c0c9-4c22-a6fd-f25e0eb5aebb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:21 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:24:21 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:21 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c" returned: 0 in 0.865s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:21 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c Jul 08 11:24:21 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:21 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 0.799s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:24:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:21 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac Jul 08 11:24:21 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:22 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf59100c-4e85-4d75-8a74-54a39a5e954c" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-cf59100c-4e85-4d75-8a74-54a39a5e954c" released by "delete_volume" :: held 1.602s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Created reservations ['f5c44983-d1c1-43bc-a91a-aa29fe18e896', '9e8a00af-6465-42d3-9047-4aa06bced2e0', '7ccd5788-94f7-475b-809f-9f917e712766', '729715bb-e07d-4034-9dbb-da9acd2111bb'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:22 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:22 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "cinder-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Acquiring lock "cinder-quobyte-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" acquired by "delete_volume" :: waited 0.043s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64da7d6-9132-4334-b04e-36db3c214ca1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:24 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:24 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:24 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:24 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Deleted volume successfully. Jul 08 11:24:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-707db342-8bc7-46e6-a6d4-2cc05bf372e1 tempest-VolumesCloneTest-1938939820 None] Lock "cinder-cf59100c-4e85-4d75-8a74-54a39a5e954c-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:26 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 2.915s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:26 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb Jul 08 11:24:26 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:28 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" returned: 0 in 2.162s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "cinder-quobyte-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb" released by "delete_volume" :: held 5.287s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Created reservations ['ae45fe10-a347-4ff5-a62b-87452285c34f', '5300494a-978b-4dda-bfbf-af5ebbc6b415', '0440ec90-5fb8-449e-a94b-c587319160b1', '3188d281-5910-4a21-9cea-eb16d4593887'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:29 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac" returned: 0 in 7.552s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef629c-20e0-4a44-9efc-891706ddea9c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:29 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:29 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:29 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:24:29 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:31 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.877s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Deleted volume successfully. Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1348928e-69ce-422a-8782-2d060f0f2e1f tempest-VolumesCloneTest-1938939820 None] Lock "cinder-e5c7b2e2-7c18-42b6-a4c1-e6466fd766fb-delete_volume" released by "delete_volume" :: held 7.861s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:31 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 1.945s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:24:31 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Converted 1024.00 MB image at 135.54 MB/s Jul 08 11:24:31 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac is being set with open permissions: ugo+rw Jul 08 11:24:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:31 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac Jul 08 11:24:31 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:32 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac" returned: 0 in 0.865s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" released by "_copy_volume_from_snapshot" :: held 12.125s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626-e25faee2-053a-4810-92ca-32ad7f7925ac" released by "_create_volume_from_snapshot" :: held 12.175s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.207s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8e21dd-0b28-4e7b-9f23-0d07df33dad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25faee2-053a-4810-92ca-32ad7f7925ac', 'volume_size': 2, 'snapshot_id': '89419e1d-b27e-4921-9d77-46892c7f9626'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f67b97d-085a-4ef5-a9d0-157bc9e0cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:32 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume volume-e25faee2-053a-4810-92ca-32ad7f7925ac (e25faee2-053a-4810-92ca-32ad7f7925ac): created successfully Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f67b97d-085a-4ef5-a9d0-157bc9e0cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (474152bc-add8-4743-8465-d8540bff3c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a8d7c9d7-52a0-4588-859b-ebfdf95c02c4 tempest-VolumesSnapshotTestJSON-1663763165 None] Created volume successfully. Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-e25faee2-053a-4810-92ca-32ad7f7925ac-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-e25faee2-053a-4810-92ca-32ad7f7925ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-83dc4893-4232-41c5-a57c-7c8a07ec8f78 tempest-TestShelveInstance-1145778754 None] Terminate volume connection completed successfully. Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-83dc4893-4232-41c5-a57c-7c8a07ec8f78 tempest-TestShelveInstance-1145778754 None] Deleting attachment ff78316f-f340-4c9e-897e-dc1baf6ff791. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:24:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a98888-cc3e-45b1-8cfe-772f5b3261c3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:33 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac Jul 08 11:24:33 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Acquiring lock "cinder-6878fe0f-1e00-4c46-bbab-a69fade72577-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "cinder-6878fe0f-1e00-4c46-bbab-a69fade72577-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Acquiring lock "cinder-quobyte-6878fe0f-1e00-4c46-bbab-a69fade72577" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "cinder-quobyte-6878fe0f-1e00-4c46-bbab-a69fade72577" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec17b1-761d-4d67-be0e-3ff44529aa7e]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:34 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:24:34 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:34 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac" returned: 0 in 1.103s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:34 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac Jul 08 11:24:34 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:35 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 1.211s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:35 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e25faee2-053a-4810-92ca-32ad7f7925ac" returned: 0 in 0.986s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-e25faee2-053a-4810-92ca-32ad7f7925ac" released by "delete_volume" :: held 2.160s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:35 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:24:35 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['e611a3aa-a745-4c10-8822-f75bf6511018', 'b47c3eaa-cb28-484a-b820-b4a6f3cdbf45', 'e6448bff-a2a3-42ef-b1b9-11350e99db62', '2311bfa6-3605-4e42-9fe6-5467c1f6734c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:35 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:35 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (2eccf41a-0d55-4433-98df-043dfacd8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bede2e-ebdf-4325-8728-a7b30db1ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bede2e-ebdf-4325-8728-a7b30db1ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-271194183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b8f9a2-2604-4d99-94f9-b0e93865783a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:36Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a3b1e-d422-4942-a6ac-5b571345a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a3b1e-d422-4942-a6ac-5b571345a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dba5be-a1ea-4886-beed-9daa744d721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dba5be-a1ea-4886-beed-9daa744d721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b8f9a2-2604-4d99-94f9-b0e93865783a', 'volume_name': 'volume-25b8f9a2-2604-4d99-94f9-b0e93865783a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effd23e5-3fb2-46d6-8cd7-a8b699d9b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effd23e5-3fb2-46d6-8cd7-a8b699d9b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ce5b52-9d52-4b6f-b50c-9a86ad5c86e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Volume 25b8f9a2-2604-4d99-94f9-b0e93865783a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b8f9a2-2604-4d99-94f9-b0e93865783a', 'volume_size': 1} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-271194183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b8f9a2-2604-4d99-94f9-b0e93865783a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:36Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Creating volume 25b8f9a2-2604-4d99-94f9-b0e93865783a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:36 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:36 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a 1073741824 Jul 08 11:24:36 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:36 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.828s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleted volume successfully. Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e3b1c1df-6265-4a2b-bce6-978d653d2391 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-e25faee2-053a-4810-92ca-32ad7f7925ac-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:36 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 1 in 1.245s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:36 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577 Jul 08 11:24:36 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-89419e1d-b27e-4921-9d77-46892c7f9626-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-89419e1d-b27e-4921-9d77-46892c7f9626-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleting offline snapshot 89419e1d-b27e-4921-9d77-46892c7f9626 of volume ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] snapshot_file for this snap is: volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcae9ab-c043-4d9b-8646-b901975a42c2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:36 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:36 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:37 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6878fe0f-1e00-4c46-bbab-a69fade72577" returned: 0 in 0.957s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "cinder-quobyte-6878fe0f-1e00-4c46-bbab-a69fade72577" released by "delete_volume" :: held 3.522s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:37 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a 1073741824" returned: 0 in 1.327s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG cinder.quota [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Created reservations ['af0a15af-24af-4a7b-80cd-f0f5f14f84bc', 'f69a8e33-090c-487c-a374-10eaf46e6b1a', '38c77043-ee9a-4b29-b8d9-4949307ae2a9', '4940a34d-41a5-4801-a0be-d9b59a93f782'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:37 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a Jul 08 11:24:37 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:37 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:37 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:37 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 1.131s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78481d-111c-4b4e-89f0-97c6fe9bc83b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:38 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:24:38 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:38 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.manager [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Deleted volume successfully. Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-2557e27b-e7ab-4358-b237-b258b0dd3b16 req-1bc7e6ec-f2d5-4b68-a93b-292b3c81609c tempest-TestShelveInstance-1145778754 None] Lock "cinder-6878fe0f-1e00-4c46-bbab-a69fade72577-delete_volume" released by "delete_volume" :: held 4.756s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:38 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a" returned: 0 in 1.148s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ce5b52-9d52-4b6f-b50c-9a86ad5c86e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b8f9a2-2604-4d99-94f9-b0e93865783a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e14544-3ecc-499d-9caf-0096548bf880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:38 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Volume volume-25b8f9a2-2604-4d99-94f9-b0e93865783a (25b8f9a2-2604-4d99-94f9-b0e93865783a): created successfully Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e14544-3ecc-499d-9caf-0096548bf880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (2eccf41a-0d55-4433-98df-043dfacd8527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6ff7eb13-e3d6-496f-b0e1-b91025f53550 tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:24:38 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 1.102s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:38 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:38 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:39 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 0.964s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:39 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626 Jul 08 11:24:39 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (4ba9c575-2dca-43c1-8ba9-19f6e44516ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170b86ac-9466-4bbb-8132-7f03976627d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170b86ac-9466-4bbb-8132-7f03976627d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1488592233',display_name='tempest-VolumesGetTest-Volume-363208292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec57eb90-ec03-4ae6-b93f-e0582905f154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:40Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089d9d47-c9fe-417d-bc27-d139cd8d772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089d9d47-c9fe-417d-bc27-d139cd8d772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0a16de-0e5b-4818-bc06-9beb49271aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0a16de-0e5b-4818-bc06-9beb49271aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec57eb90-ec03-4ae6-b93f-e0582905f154', 'volume_name': 'volume-ec57eb90-ec03-4ae6-b93f-e0582905f154', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af16116-0447-4464-8f8c-1a80da59aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af16116-0447-4464-8f8c-1a80da59aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce547b4-a288-436b-8d42-7cb3dda6776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:40 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Volume ec57eb90-ec03-4ae6-b93f-e0582905f154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec57eb90-ec03-4ae6-b93f-e0582905f154', 'volume_size': 1} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1488592233',display_name='tempest-VolumesGetTest-Volume-363208292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec57eb90-ec03-4ae6-b93f-e0582905f154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:40Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Creating volume ec57eb90-ec03-4ae6-b93f-e0582905f154 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:40 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:40 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 1073741824 Jul 08 11:24:40 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:40 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2.89419e1d-b27e-4921-9d77-46892c7f9626" returned: 0 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-89419e1d-b27e-4921-9d77-46892c7f9626" released by "_delete_snapshot" :: held 4.232s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" released by "delete_snapshot" :: held 4.293s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['fe6cbd84-1e26-49bb-b112-17d8d4c678af', 'ed41e6a7-2620-4088-9604-532889444f42', 'f4b29544-a89e-45a3-84af-0c5f1aceb602', '39c84701-8d19-4e73-abcb-5816afbd1f81'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Delete snapshot completed successfully. Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b119a53-5eab-4bf2-88ac-ee01023e3165 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-89419e1d-b27e-4921-9d77-46892c7f9626-delete_snapshot" released by "delete_snapshot" :: held 4.545s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:41 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 1073741824" returned: 0 in 1.193s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:41 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 Jul 08 11:24:41 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-ad20a866-90ff-4855-a2f9-38b3fd2baca2-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-ad20a866-90ff-4855-a2f9-38b3fd2baca2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c07ff-c54a-47f8-8fbd-a2f5321dbe4e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:42 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:24:42 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:42 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce547b4-a288-436b-8d42-7cb3dda6776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec57eb90-ec03-4ae6-b93f-e0582905f154', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de505e2-5b24-474c-beb2-aaceec3a5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:42 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Volume volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 (ec57eb90-ec03-4ae6-b93f-e0582905f154): created successfully Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de505e2-5b24-474c-beb2-aaceec3a5020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (4ba9c575-2dca-43c1-8ba9-19f6e44516ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5274b626-08d5-4ba6-a9f3-4b7e89bda491 tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:24:42 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 0.861s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:42 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2 Jul 08 11:24:42 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-ec57eb90-ec03-4ae6-b93f-e0582905f154-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "cinder-ec57eb90-ec03-4ae6-b93f-e0582905f154-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-ec57eb90-ec03-4ae6-b93f-e0582905f154" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-ec57eb90-ec03-4ae6-b93f-e0582905f154" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:43 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ad20a866-90ff-4855-a2f9-38b3fd2baca2" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d817a5ce-5370-4b95-9cbc-6da664075c99]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-ad20a866-90ff-4855-a2f9-38b3fd2baca2" released by "delete_volume" :: held 1.627s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['e3211151-2a55-4c0c-a47b-425b885e5cd8', 'f9f88b22-d3e6-4ae9-9222-4604bfd2c88f', 'd627b445-2deb-4370-9dff-1d466c34bb10', '58bcbc81-22da-48b1-be36-56e7bece385e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:43 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 Jul 08 11:24:43 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:43 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:43 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:44 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154" returned: 0 in 0.871s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:44 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154 Jul 08 11:24:44 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:44 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleted volume successfully. Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-261a157b-b2c0-49f6-a18a-88042d6079e4 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-ad20a866-90ff-4855-a2f9-38b3fd2baca2-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (d3cfc5a2-f92b-443c-8e74-7edfe8eeb75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2fa2c5-0c08-46b1-a1e1-d70738d7c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2fa2c5-0c08-46b1-a1e1-d70738d7c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-8248620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817b75f3-5aaa-4839-88ee-05719dfcbe3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:45Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5dba4f-f00e-4303-b028-928842cfce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5dba4f-f00e-4303-b028-928842cfce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e3d8f-4416-4abe-ba52-5519538f8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e3d8f-4416-4abe-ba52-5519538f8da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817b75f3-5aaa-4839-88ee-05719dfcbe3c', 'volume_name': 'volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2921494-b941-4549-9cb7-8f1e717d5f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2921494-b941-4549-9cb7-8f1e717d5f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf105864-6221-487b-825e-327d1d64c04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume 817b75f3-5aaa-4839-88ee-05719dfcbe3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c', 'volume_size': 1} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-8248620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817b75f3-5aaa-4839-88ee-05719dfcbe3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:45Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating volume 817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:44 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:44 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c 1073741824 Jul 08 11:24:44 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:45 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec57eb90-ec03-4ae6-b93f-e0582905f154" returned: 0 in 0.871s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-ec57eb90-ec03-4ae6-b93f-e0582905f154" released by "delete_volume" :: held 1.793s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=84,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=11 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Created reservations ['2452c35c-1bb4-4c8a-9312-168a70a25b26', '1985e8bf-b57a-477f-9a55-8c5e3068e306', '7d37855b-d062-4b6f-89eb-c1344100ceb1', '8c2d6039-4429-4e61-a058-db9023d56ecd'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:45 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:45 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-25b8f9a2-2604-4d99-94f9-b0e93865783a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "cinder-25b8f9a2-2604-4d99-94f9-b0e93865783a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:45 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c 1073741824" returned: 0 in 1.056s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-25b8f9a2-2604-4d99-94f9-b0e93865783a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-25b8f9a2-2604-4d99-94f9-b0e93865783a" acquired by "delete_volume" :: waited 0.054s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:46 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:24:46 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004a49a-7a05-4114-94ab-d9e64e893978]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:46 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a Jul 08 11:24:46 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:46 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.918s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-676ee1d4-19af-4415-ae76-e20be879cf88 tempest-VolumesGetTest-241496992 None] Lock "cinder-ec57eb90-ec03-4ae6-b93f-e0582905f154-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:46 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 0.739s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf105864-6221-487b-825e-327d1d64c04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33f2eab-fa36-4638-a359-af10bfc69659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c (817b75f3-5aaa-4839-88ee-05719dfcbe3c): created successfully Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33f2eab-fa36-4638-a359-af10bfc69659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (d3cfc5a2-f92b-443c-8e74-7edfe8eeb75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ae5134ea-5366-4bbf-bdc4-cfa8a8f5a442 tempest-VolumesSnapshotTestJSON-1663763165 None] Created volume successfully. Jul 08 11:24:47 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a" returned: 0 in 1.006s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:47 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a Jul 08 11:24:47 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:47 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25b8f9a2-2604-4d99-94f9-b0e93865783a" returned: 0 in 0.724s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-25b8f9a2-2604-4d99-94f9-b0e93865783a" released by "delete_volume" :: held 1.787s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Created reservations ['74835ee0-5199-45af-97fd-f5c15b4b0af9', '688ec679-9fce-47b8-beba-e3994f37dfde', '880c8048-3006-43f0-840f-42baff9e32e2', '0cfaf8f7-bb3d-416b-9cdc-bfc6850ad846'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:48 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:48 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Creating offline snapshot 09828945-79e4-4e4a-a965-3a7d15d9d964 of volume 817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:24:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9a1b8-9aa4-430c-a447-17d43138856e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:48 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:24:48 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (a0bc8443-2f5c-4d46-be9d-95914a986c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2ef684-2420-4d05-ad74-ab38680e5e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:49 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.070s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2ef684-2420-4d05-ad74-ab38680e5e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-404944447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9b0f55-02c1-4631-a2f4-071b7a2c5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:49Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab57616a-4c62-4087-94b4-0d5d7acbf8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab57616a-4c62-4087-94b4-0d5d7acbf8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce294df-fee1-41b4-a066-5c7a8a2e5e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce294df-fee1-41b4-a066-5c7a8a2e5e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'volume_name': 'volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba5a887-002a-40f4-afbc-ec71a5c85405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba5a887-002a-40f4-afbc-ec71a5c85405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45deeaa5-68d4-4923-b013-1c66bb0dc381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:49 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Volume 6b9b0f55-02c1-4631-a2f4-071b7a2c5456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'volume_size': 1} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-792f5107-a37a-4991-8ffc-7f4a57123ec0 tempest-VolumesGetTest-241496992 None] Lock "cinder-25b8f9a2-2604-4d99-94f9-b0e93865783a-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:24:49 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 1.083s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:49 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 1G Jul 08 11:24:49 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:50 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 1G" returned: 0 in 0.829s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:50 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:24:50 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (7c9bf0d7-4f8d-4cb5-a6d3-9a5ec1770679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b802ad-e295-4b7b-949f-cae5ecb21d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b802ad-e295-4b7b-949f-cae5ecb21d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158833099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29672e7e-9ccb-47ce-8990-1446c08f1582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:51Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08699fda-c17a-478f-be14-a8684c6f3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08699fda-c17a-478f-be14-a8684c6f3b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09922773-d58e-4d6b-83a6-00b97da28211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09922773-d58e-4d6b-83a6-00b97da28211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29672e7e-9ccb-47ce-8990-1446c08f1582', 'volume_name': 'volume-29672e7e-9ccb-47ce-8990-1446c08f1582', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5cf27f-b229-4412-b72f-908240d5972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5cf27f-b229-4412-b72f-908240d5972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b85133-4c26-4136-9211-b3331f5120bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume 29672e7e-9ccb-47ce-8990-1446c08f1582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29672e7e-9ccb-47ce-8990-1446c08f1582', 'volume_size': 1} Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:50 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.730s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:50 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 is being set with open permissions: ugo+rw Jul 08 11:24:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:51 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:24:51 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:51 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:51 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info Jul 08 11:24:51 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:52 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:24:52 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:52 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info" returned: 0 in 0.652s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:52 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info is being set with open permissions: ugo+rw Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:52 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info Jul 08 11:24:52 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:52 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:53 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:53 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (554d0606-57c1-4f5a-afc5-0aed255ba30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b65fe0-849b-4d40-92ff-17f8459fc150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.737s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.info" returned: 0 in 0.688s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-404944447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9b0f55-02c1-4631-a2f4-071b7a2c5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:49Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Creating volume 6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:53 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:24:53 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 1073741824 Jul 08 11:24:53 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b65fe0-849b-4d40-92ff-17f8459fc150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1094268580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d067fd-7e85-4948-ac62-9f2496701c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:53Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac64819-e856-4c0e-ab71-795c88bf7c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac64819-e856-4c0e-ab71-795c88bf7c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810bea9-321c-4c10-9531-8674b276bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d810bea9-321c-4c10-9531-8674b276bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d067fd-7e85-4948-ac62-9f2496701c16', 'volume_name': 'volume-f4d067fd-7e85-4948-ac62-9f2496701c16', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80573d00-9b77-4272-a803-3f0b87a5d723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80573d00-9b77-4272-a803-3f0b87a5d723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244609fb-4a8c-4074-bb41-31317875d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:53 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Volume f4d067fd-7e85-4948-ac62-9f2496701c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d067fd-7e85-4948-ac62-9f2496701c16', 'volume_size': 1} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b23dd343-b825-4469-9708-a082c38e1e0f tempest-VolumesSnapshotTestJSON-1663763165 None] Create snapshot completed successfully Jul 08 11:24:53 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 1073741824" returned: 0 in 0.878s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:54 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:24:54 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (a1dc22c2-76b7-4fa8-bb71-1792660cdd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2c18f-c8b8-4d65-bf5a-89da5d251be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2c18f-c8b8-4d65-bf5a-89da5d251be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1814213866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540d697a-e7c1-4837-a1e2-f939e0d7fe8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290d09e2c19d4374a3b6f9b021d8d12b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=09828945-79e4-4e4a-a965-3a7d15d9d964,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:54Z,use_quota=True,user_id='788b1e44a80a4f58bd8e4cce9395f003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1addf2c-b945-4ccc-b31d-1c9ff633105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1addf2c-b945-4ccc-b31d-1c9ff633105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3ac376-ab7b-4528-9c2f-dc2eab6585fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3ac376-ab7b-4528-9c2f-dc2eab6585fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '540d697a-e7c1-4837-a1e2-f939e0d7fe8e', 'volume_name': 'volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e', 'volume_size': 1, 'snapshot_id': '09828945-79e4-4e4a-a965-3a7d15d9d964'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6eccc1-7b67-47a5-8008-12a033ccba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6eccc1-7b67-47a5-8008-12a033ccba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7b685-bd75-48eb-9242-35d70e31ead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume 540d697a-e7c1-4837-a1e2-f939e0d7fe8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e', 'volume_size': 1, 'snapshot_id': '09828945-79e4-4e4a-a965-3a7d15d9d964'} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:54 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.899s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158833099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29672e7e-9ccb-47ce-8990-1446c08f1582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:51Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume 29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:54 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:54 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 1073741824 Jul 08 11:24:54 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45deeaa5-68d4-4923-b013-1c66bb0dc381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2f0a8-426d-418e-a4a4-7dc158b2472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:54 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Volume volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 (6b9b0f55-02c1-4631-a2f4-071b7a2c5456): created successfully Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f2f0a8-426d-418e-a4a4-7dc158b2472d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (a0bc8443-2f5c-4d46-be9d-95914a986c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d104f5f0-5eb0-461f-9dea-54f7e85702aa tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:24:55 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 1073741824" returned: 0 in 0.812s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:55 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 Jul 08 11:24:55 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (ef943999-9d9d-432c-99c7-6d41b3212330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98fbf0-5640-4992-9cc5-a2a44c84f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e98fbf0-5640-4992-9cc5-a2a44c84f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1181913920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d525b90-b3d6-4cbd-8d29-7b701e9d7895,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6b9b0f55-02c1-4631-a2f4-071b7a2c5456,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:56Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e3ddd-90bc-4b61-afac-c1847643f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e3ddd-90bc-4b61-afac-c1847643f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628233f4-003d-4cba-a59e-838db068282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628233f4-003d-4cba-a59e-838db068282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d525b90-b3d6-4cbd-8d29-7b701e9d7895', 'volume_name': 'volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895', 'volume_size': 1, 'source_volid': '6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'source_volstatus': 'available'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f49a1c3-30bb-4b6d-802c-9248b7708a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f49a1c3-30bb-4b6d-802c-9248b7708a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58ca500-45ed-45bd-98c0-572515c600ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:55 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Volume 8d525b90-b3d6-4cbd-8d29-7b701e9d7895: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895', 'volume_size': 1, 'source_volid': '6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'source_volstatus': 'available'} Jul 08 11:24:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:56 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582" returned: 0 in 0.694s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.051s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1094268580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d067fd-7e85-4948-ac62-9f2496701c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='784a41a2b5cf4ad6a5c69e364520042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:24:53Z,use_quota=True,user_id='a71c8e39887141e2a980fc83414dea38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Creating volume f4d067fd-7e85-4948-ac62-9f2496701c16 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:56 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:56 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 1073741824 Jul 08 11:24:56 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b85133-4c26-4136-9211-b3331f5120bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29672e7e-9ccb-47ce-8990-1446c08f1582', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c1dbf-8b35-43c8-a938-30d65cd06f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-29672e7e-9ccb-47ce-8990-1446c08f1582 (29672e7e-9ccb-47ce-8990-1446c08f1582): created successfully Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (223c1dbf-8b35-43c8-a938-30d65cd06f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (7c9bf0d7-4f8d-4cb5-a6d3-9a5ec1770679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3be9d2f4-641b-4a0c-9363-2b2058bca79c tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:24:57 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 1073741824" returned: 0 in 0.818s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:57 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 Jul 08 11:24:57 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:57 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.599s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating volume 540d697a-e7c1-4837-a1e2-f939e0d7fe8e from snapshot 09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244609fb-4a8c-4074-bb41-31317875d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d067fd-7e85-4948-ac62-9f2496701c16', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a976e-e2a3-4a2b-814d-9cfc1eade9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] snapshot: 09828945-79e4-4e4a-a965-3a7d15d9d964, volume: 540d697a-e7c1-4837-a1e2-f939e0d7fe8e, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:24:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Volume volume-f4d067fd-7e85-4948-ac62-9f2496701c16 (f4d067fd-7e85-4948-ac62-9f2496701c16): created successfully Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836a976e-e2a3-4a2b-814d-9cfc1eade9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Flow 'volume_create_manager' (554d0606-57c1-4f5a-afc5-0aed255ba30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:24:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-00015007-aa80-4bd5-9f51-be38affe1e1f tempest-AttachVolumeNegativeTest-1942800585 None] Created volume successfully. Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2612d-9ab7-42c3-a1b7-0028b008a04f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:57 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:24:57 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:58 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.750s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14ae41-a302-4177-a4ac-c218e889eaf5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:24:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:58 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:24:58 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:24:59 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 08 11:24:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:24:59 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:24:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:24:59 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e Jul 08 11:24:59 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:04 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" returned: 0 in 4.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a836e8-c677-4ef2-9df1-7b09b8b312e8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:04 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:25:04 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:05 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 0.937s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:25:05 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Converted 1024.00 MB image at 206.35 MB/s Jul 08 11:25:05 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e is being set with open permissions: ugo+rw Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:05 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e Jul 08 11:25:05 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:05 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" released by "_copy_volume_from_snapshot" :: held 8.182s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" released by "_create_volume_from_snapshot" :: held 8.231s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.250s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.045s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:05 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Cloning volume 6b9b0f55-02c1-4631-a2f4-071b7a2c5456 to volume 8d525b90-b3d6-4cbd-8d29-7b701e9d7895 Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7b685-bd75-48eb-9242-35d70e31ead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e', 'volume_size': 1, 'snapshot_id': '09828945-79e4-4e4a-a965-3a7d15d9d964'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ee173c-8de1-48fd-a542-eb86328e5aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Creating offline snapshot 2529829e-6ff2-4768-ad61-d236353c92dc of volume 6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:25:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Volume volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e (540d697a-e7c1-4837-a1e2-f939e0d7fe8e): created successfully Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ee173c-8de1-48fd-a542-eb86328e5aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Flow 'volume_create_manager' (a1dc22c2-76b7-4fa8-bb71-1792660cdd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccea615a-f425-442b-8b0a-f4d9614d897b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bc823702-6313-423a-ab8c-4ea485af3322 tempest-VolumesSnapshotTestJSON-1663763165 None] Created volume successfully. Jul 08 11:25:06 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:06 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:06 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 0.736s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:06 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc 1G Jul 08 11:25:06 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-540d697a-e7c1-4837-a1e2-f939e0d7fe8e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-540d697a-e7c1-4837-a1e2-f939e0d7fe8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[00707311-ae42-4520-8528-2a6e4afa3e4a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:07 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e Jul 08 11:25:07 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:07 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc 1G" returned: 0 in 0.778s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:07 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:07 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:08 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:08 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e Jul 08 11:25:08 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:08 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.688s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:08 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc is being set with open permissions: ugo+rw Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:08 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:08 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:08 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-540d697a-e7c1-4837-a1e2-f939e0d7fe8e" released by "delete_volume" :: held 1.448s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['c18d81b5-586f-4845-928b-76b745e4a7e9', '337ab405-e525-47c4-90ac-7f32bcaaa529', '931a9acb-90bc-4209-a498-e7743919c2a7', '27a1fc0d-bd5c-4a9e-b351-0e5ffdc3cf63'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:08 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:08 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:08 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:08 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info Jul 08 11:25:08 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-09828945-79e4-4e4a-a965-3a7d15d9d964-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-09828945-79e4-4e4a-a965-3a7d15d9d964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:09 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Deleted volume successfully. Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Deleting offline snapshot 09828945-79e4-4e4a-a965-3a7d15d9d964 of volume 817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] snapshot_file for this snap is: volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-cf337152-df5d-406d-b7d6-cfe868bc95bf tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-540d697a-e7c1-4837-a1e2-f939e0d7fe8e-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadac2d-e691-4235-8991-058208134e1f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:09 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:09 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info is being set with open permissions: ugo+rw Jul 08 11:25:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:09 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:25:09 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:09 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info Jul 08 11:25:09 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:10 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.info" returned: 0 in 0.662s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:10 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.775s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] snapshot: 2529829e-6ff2-4768-ad61-d236353c92dc, volume: 8d525b90-b3d6-4cbd-8d29-7b701e9d7895, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6aaa80-2d5d-4110-8098-f93aab7f71cd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f82996-67d6-4f56-8cf8-5dbb8920d9b0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:10 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:25:10 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:10 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:10 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:11 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 0.769s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:11 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.770s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:25:11 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:25:11 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40aa60-85a7-4d12-969b-34b9c4ac4a19]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:11 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:11 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:11 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:11 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964 Jul 08 11:25:11 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:11 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 0.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:25:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:11 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 Jul 08 11:25:11 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:12 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c.09828945-79e4-4e4a-a965-3a7d15d9d964" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-09828945-79e4-4e4a-a965-3a7d15d9d964" released by "_delete_snapshot" :: held 3.075s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" released by "delete_snapshot" :: held 3.116s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:12 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['ebad3755-f196-46ba-8e8c-ed2e16d8a221', '4e49972b-08eb-4f44-bc08-24314fc15439', 'bb7d6948-6e1f-4996-8df0-63d67135052d', '2b42eba1-777c-425e-8b5b-09ac169a3677'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Delete snapshot completed successfully. Jul 08 11:25:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef605bd7-3292-4435-9896-c1a01a82c8fa tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-09828945-79e4-4e4a-a965-3a7d15d9d964-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-817b75f3-5aaa-4839-88ee-05719dfcbe3c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-817b75f3-5aaa-4839-88ee-05719dfcbe3c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" acquired by "delete_volume" :: waited 0.042s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c114f14-4bfe-4117-8a8e-3ba08ec1bfd5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:14 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:25:14 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:15 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 1.582s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:15 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c Jul 08 11:25:15 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:17 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" returned: 0 in 5.245s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[507745a6-3051-4478-bb22-a2d70b38cbc5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:17 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-817b75f3-5aaa-4839-88ee-05719dfcbe3c" returned: 0 in 1.393s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-817b75f3-5aaa-4839-88ee-05719dfcbe3c" released by "delete_volume" :: held 3.080s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=96,cinder:SELECT=81,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:25:17 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:17 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['ff65cc7d-075f-43b4-900e-765883f6e2d3', '3a31bc01-67c1-4f40-be42-164e8ffb3c00', '3f17ee82-cbe7-4d5f-8b30-09141893f87e', 'c0fda10b-2b25-4e39-9342-60322626d103'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:17 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:17 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-3627c540-1e30-43a6-9861-2e6e659f4c13-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-3627c540-1e30-43a6-9861-2e6e659f4c13-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69a1d6-045c-4bb2-bc3f-062b3f48f9bc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:17 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 Jul 08 11:25:17 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:18 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleted volume successfully. Jul 08 11:25:18 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 1.007s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:25:18 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Converted 1024.00 MB image at 195.19 MB/s Jul 08 11:25:18 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 is being set with open permissions: ugo+rw Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-524f8bd6-2a14-4c4d-a75f-140c803150f7 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-817b75f3-5aaa-4839-88ee-05719dfcbe3c-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:18 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 Jul 08 11:25:18 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:18 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:18 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13 Jul 08 11:25:18 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:18 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" returned: 0 in 0.691s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" released by "_copy_volume_from_snapshot" :: held 8.579s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-2529829e-6ff2-4768-ad61-d236353c92dc" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-2529829e-6ff2-4768-ad61-d236353c92dc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Deleting offline snapshot 2529829e-6ff2-4768-ad61-d236353c92dc of volume 6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] snapshot_file for this snap is: volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469dbd9-540c-4282-9223-7829a54a9e4c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:19 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:19 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:19 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3627c540-1e30-43a6-9861-2e6e659f4c13" returned: 0 in 0.688s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-quobyte-3627c540-1e30-43a6-9861-2e6e659f4c13" released by "delete_volume" :: held 1.574s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Created reservations ['c0d00e1d-b5f6-4a01-a9ae-1848979059ef', 'a3ea928b-acb2-4c6c-a9a9-dbb9ce93d247', '353dde8c-3fa4-4c85-ac24-bebda20d88e3', '421c6c1d-bad2-462c-bb02-2f7b44df1f4f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:19 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:19 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:19 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.775s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8da6c4a-a04a-4916-9d37-37bd0faabf69]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:19 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:19 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:20 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.669s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:20 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Deleted volume successfully. Jul 08 11:25:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26b06559-0326-4076-a782-2f1eaed23fa8 tempest-VolumesSnapshotTestJSON-1663763165 None] Lock "cinder-3627c540-1e30-43a6-9861-2e6e659f4c13-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:20 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 0.810s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:20 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:20 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:21 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.780s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:21 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc Jul 08 11:25:21 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:22 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456.2529829e-6ff2-4768-ad61-d236353c92dc" returned: 0 in 0.646s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-2529829e-6ff2-4768-ad61-d236353c92dc" released by "_delete_snapshot" :: held 3.123s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.137s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.877s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58ca500-45ed-45bd-98c0-572515c600ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895', 'volume_size': 1, 'source_volid': '6b9b0f55-02c1-4631-a2f4-071b7a2c5456', 'source_volstatus': 'available'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dfcc5d-64fa-4c9f-90b4-5535ec7bb0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating offline snapshot 0713870c-71ba-4e05-9a84-b00415e34f4c of volume 29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:25:22 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Volume volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 (8d525b90-b3d6-4cbd-8d29-7b701e9d7895): created successfully Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dfcc5d-64fa-4c9f-90b4-5535ec7bb0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (ef943999-9d9d-432c-99c7-6d41b3212330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a7a15-98df-44e6-941c-d86ed1f21568]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2158f9fd-fb88-490f-957a-78db33557dbd tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:25:22 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 Jul 08 11:25:22 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:22 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582" returned: 0 in 0.796s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:23 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c 1G Jul 08 11:25:23 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (77e222d4-573e-4fcb-9782-46f24543ee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608c6f8-5853-43f1-8ebf-7ac7905a9812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c608c6f8-5853-43f1-8ebf-7ac7905a9812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-322917102',display_name='tempest-VolumesGetTest-Volume-1923617131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699f6342-6f92-467b-bd7d-116385633450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:24Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a19b35-9ae2-40bb-bc1b-87cfb1a1ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a19b35-9ae2-40bb-bc1b-87cfb1a1ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb1de2-31c9-4c4c-9c68-a39e6d1dbfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcb1de2-31c9-4c4c-9c68-a39e6d1dbfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699f6342-6f92-467b-bd7d-116385633450', 'volume_name': 'volume-699f6342-6f92-467b-bd7d-116385633450', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5339edb5-8bc1-4f7c-a403-7ad73e309cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5339edb5-8bc1-4f7c-a403-7ad73e309cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70298e97-63f3-4338-b215-d9e8789b88f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:23 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Volume 699f6342-6f92-467b-bd7d-116385633450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699f6342-6f92-467b-bd7d-116385633450', 'volume_size': 1} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:23 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c 1G" returned: 0 in 1.029s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29672e7e-9ccb-47ce-8990-1446c08f1582 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:24 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29672e7e-9ccb-47ce-8990-1446c08f1582 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c Jul 08 11:25:24 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:24 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29672e7e-9ccb-47ce-8990-1446c08f1582 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:24 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c is being set with open permissions: ugo+rw Jul 08 11:25:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:24 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c Jul 08 11:25:24 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:25 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:25 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info Jul 08 11:25:25 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:26 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:26 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info is being set with open permissions: ugo+rw Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:26 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info Jul 08 11:25:26 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:26 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.info" returned: 0 in 0.718s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.728s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.477s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae9d49-e08d-4112-99df-333f700e9f8f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e464ac1f-970c-4aa5-abe4-e241381edcc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Create snapshot completed successfully Jul 08 11:25:26 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 Jul 08 11:25:26 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:27 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.835s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-322917102',display_name='tempest-VolumesGetTest-Volume-1923617131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699f6342-6f92-467b-bd7d-116385633450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:24Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Creating volume 699f6342-6f92-467b-bd7d-116385633450 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:27 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:27 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 1073741824 Jul 08 11:25:27 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-f4d067fd-7e85-4948-ac62-9f2496701c16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a37f8980-e215-4aa1-96f8-1d8e47516045', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:25:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-3c948a92-feea-4052-bf28-ed3ca779423c req-16ae2d1f-8fbe-45d7-82ce-cbe23028e4c3 tempest-AttachVolumeNegativeTest-1942800585 None] attachment_update completed successfully. Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (95726fa2-0dab-4435-a2a6-6f6e9498cd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d104b8eb-b228-416d-a589-54bc792ec846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d104b8eb-b228-416d-a589-54bc792ec846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595267169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14313e7-c3a7-4cfb-9eed-515a3eda54da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:28Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcd8c7b-fbdf-49af-b66c-2af1db03e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcd8c7b-fbdf-49af-b66c-2af1db03e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f307c0-2c2d-4bb9-ad2c-229346cd4c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f307c0-2c2d-4bb9-ad2c-229346cd4c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14313e7-c3a7-4cfb-9eed-515a3eda54da', 'volume_name': 'volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6cc9f3-3edd-440f-9239-0bb225b42ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6cc9f3-3edd-440f-9239-0bb225b42ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8987ed-cc6e-4e7c-bd31-a7d88a44f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:28 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume b14313e7-c3a7-4cfb-9eed-515a3eda54da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da', 'volume_size': 1} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:28 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 1073741824" returned: 0 in 1.044s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:28 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 Jul 08 11:25:28 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:28 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (0df8e235-3cff-4352-ba73-256f5896c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde452e7-dc95-4386-b7cf-f654ff24fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde452e7-dc95-4386-b7cf-f654ff24fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080190324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e397da0-afd6-4442-b127-245fe96fe1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:29Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e12734-cc39-4b1e-8b1d-ff27e760aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e12734-cc39-4b1e-8b1d-ff27e760aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d554eb03-7ca9-4ea8-9cfa-0e17a9b097a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d554eb03-7ca9-4ea8-9cfa-0e17a9b097a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e397da0-afd6-4442-b127-245fe96fe1b1', 'volume_name': 'volume-9e397da0-afd6-4442-b127-245fe96fe1b1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aed446-2575-47b4-95df-e804b924cdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aed446-2575-47b4-95df-e804b924cdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91e97e2-283b-4490-a412-06e2f5578463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume 9e397da0-afd6-4442-b127-245fe96fe1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e397da0-afd6-4442-b127-245fe96fe1b1', 'volume_size': 1} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (8b002be3-cfae-49f7-b31f-c66b6cda81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a9c3b4-92e0-4321-9f79-9a610cd94662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a9c3b4-92e0-4321-9f79-9a610cd94662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1771081479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ac908-3206-4887-b51b-2bfd08a6196b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:29Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bc15b5-ae37-45bb-b55b-b021dd2a796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bc15b5-ae37-45bb-b55b-b021dd2a796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41102a9-34a2-436e-8f8a-62396896662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41102a9-34a2-436e-8f8a-62396896662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75ac908-3206-4887-b51b-2bfd08a6196b', 'volume_name': 'volume-c75ac908-3206-4887-b51b-2bfd08a6196b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3c3cd3-20fd-4e5e-b7c6-f4478b96afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3c3cd3-20fd-4e5e-b7c6-f4478b96afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4bb7a9-98c4-4547-aefb-1de0922e7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume c75ac908-3206-4887-b51b-2bfd08a6196b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75ac908-3206-4887-b51b-2bfd08a6196b', 'volume_size': 1} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:29 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450" returned: 0 in 0.974s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595267169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14313e7-c3a7-4cfb-9eed-515a3eda54da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:28Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume b14313e7-c3a7-4cfb-9eed-515a3eda54da {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:29 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:29 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da 1073741824 Jul 08 11:25:29 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70298e97-63f3-4338-b215-d9e8789b88f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699f6342-6f92-467b-bd7d-116385633450', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86793ff0-93d0-4608-8c1b-ca9841e0a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Volume volume-699f6342-6f92-467b-bd7d-116385633450 (699f6342-6f92-467b-bd7d-116385633450): created successfully Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86793ff0-93d0-4608-8c1b-ca9841e0a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (77e222d4-573e-4fcb-9782-46f24543ee9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d77294c6-3804-4959-a6ea-4f1cd3c68cc5 tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (a3687641-d655-4952-b378-ffe75c531a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f402b418-aaf7-46da-bf35-7b7071f1e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f402b418-aaf7-46da-bf35-7b7071f1e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970388737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b5ca8c-053d-4043-a185-2fc165758006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:30Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360760a6-cc90-4b3c-bc41-d75257c55f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360760a6-cc90-4b3c-bc41-d75257c55f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355b291e-3881-4ec3-af02-dd4db65187cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355b291e-3881-4ec3-af02-dd4db65187cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b5ca8c-053d-4043-a185-2fc165758006', 'volume_name': 'volume-46b5ca8c-053d-4043-a185-2fc165758006', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc08ae-d976-4338-8d74-a05ed440119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fc08ae-d976-4338-8d74-a05ed440119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d2911-e71e-492b-afcc-36da3d43a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume 46b5ca8c-053d-4043-a185-2fc165758006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b5ca8c-053d-4043-a185-2fc165758006', 'volume_size': 1} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-699f6342-6f92-467b-bd7d-116385633450-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "cinder-699f6342-6f92-467b-bd7d-116385633450-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-699f6342-6f92-467b-bd7d-116385633450" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-699f6342-6f92-467b-bd7d-116385633450" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1491b-ef8a-44b7-8b54-0ada222f659d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:30 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 Jul 08 11:25:30 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (df8789d3-c059-4adb-8b57-48541dcfa88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2a814d-dd04-4e95-af14-9075d5eb3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2a814d-dd04-4e95-af14-9075d5eb3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098544105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eaea05-88af-424f-9581-ab6985e201a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:31Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ffbea4-fd59-40e1-867d-44cbc9b45f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ffbea4-fd59-40e1-867d-44cbc9b45f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a5e5e-0347-4d54-9056-1de7966a5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a5e5e-0347-4d54-9056-1de7966a5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7eaea05-88af-424f-9581-ab6985e201a8', 'volume_name': 'volume-d7eaea05-88af-424f-9581-ab6985e201a8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62301df1-c252-4cab-bafe-602404cd1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62301df1-c252-4cab-bafe-602404cd1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b736037-0417-46f8-9806-ad524c5a8f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:30 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume d7eaea05-88af-424f-9581-ab6985e201a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7eaea05-88af-424f-9581-ab6985e201a8', 'volume_size': 1} Jul 08 11:25:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:31 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da 1073741824" returned: 0 in 1.325s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:31 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da Jul 08 11:25:31 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:31 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450" returned: 0 in 1.148s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:31 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450 Jul 08 11:25:31 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:32 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da" returned: 0 in 0.894s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.934s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080190324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e397da0-afd6-4442-b127-245fe96fe1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:29Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume 9e397da0-afd6-4442-b127-245fe96fe1b1 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:32 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:32 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 1073741824 Jul 08 11:25:32 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8987ed-cc6e-4e7c-bd31-a7d88a44f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f31f8-1fec-4848-b06c-0086d2ac1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:32 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da (b14313e7-c3a7-4cfb-9eed-515a3eda54da): created successfully Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f31f8-1fec-4848-b06c-0086d2ac1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (95726fa2-0dab-4435-a2a6-6f6e9498cd99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5fe43d8d-228a-40d2-8ed5-1f247ed2857b tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:25:32 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-699f6342-6f92-467b-bd7d-116385633450" returned: 0 in 0.912s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-699f6342-6f92-467b-bd7d-116385633450" released by "delete_volume" :: held 2.142s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:32 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Created reservations ['40df1818-a6ef-4a0b-bfe1-b3b925d8aa39', '23309daf-4265-46d9-b55f-3bf051c690df', 'e98f5934-e550-441d-bea6-eadff8f4f99b', 'f77bba18-e80a-4632-a25f-5084ba77aaf7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:33 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:33 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:33 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 1073741824" returned: 0 in 1.156s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:33 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 Jul 08 11:25:33 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:33 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.685s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-451ffab4-0f9a-447a-a7b7-01294ad39928 tempest-VolumesGetTest-241496992 None] Lock "cinder-699f6342-6f92-467b-bd7d-116385633450-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:33 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.357s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1771081479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ac908-3206-4887-b51b-2bfd08a6196b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:29Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume c75ac908-3206-4887-b51b-2bfd08a6196b {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:33 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:34 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b 1073741824 Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91e97e2-283b-4490-a412-06e2f5578463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e397da0-afd6-4442-b127-245fe96fe1b1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:34 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a92f73-3157-4f68-b059-1f117a025558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-9e397da0-afd6-4442-b127-245fe96fe1b1 (9e397da0-afd6-4442-b127-245fe96fe1b1): created successfully Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a92f73-3157-4f68-b059-1f117a025558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (0df8e235-3cff-4352-ba73-256f5896c054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-8d525b90-b3d6-4cbd-8d29-7b701e9d7895-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f2757d22-d0c0-447b-98c1-80999dd8f2eb tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "cinder-8d525b90-b3d6-4cbd-8d29-7b701e9d7895-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd258e4-b751-4563-b9b5-35fe3b57ce6d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-73b16926-35a9-4701-9ce4-406b72896e42 req-7b28e9e2-6ef8-4d76-bd14-1e906951bed9 tempest-AttachVolumeNegativeTest-1942800585 None] Terminate volume connection completed successfully. Jul 08 11:25:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-73b16926-35a9-4701-9ce4-406b72896e42 req-7b28e9e2-6ef8-4d76-bd14-1e906951bed9 tempest-AttachVolumeNegativeTest-1942800585 None] Deleting attachment a37f8980-e215-4aa1-96f8-1d8e47516045. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:25:34 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 Jul 08 11:25:34 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:35 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b 1073741824" returned: 0 in 1.198s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:35 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b Jul 08 11:25:35 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:35 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" returned: 0 in 0.967s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:35 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895 Jul 08 11:25:35 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:35 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b" returned: 0 in 0.718s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.404s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970388737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b5ca8c-053d-4043-a185-2fc165758006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:30Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume 46b5ca8c-053d-4043-a185-2fc165758006 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:35 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:36 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4bb7a9-98c4-4547-aefb-1de0922e7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75ac908-3206-4887-b51b-2bfd08a6196b', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:36 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 1073741824 Jul 08 11:25:36 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc4995-139e-4b66-8a30-59fa594820c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" returned: 0 in 0.713s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-c75ac908-3206-4887-b51b-2bfd08a6196b (c75ac908-3206-4887-b51b-2bfd08a6196b): created successfully Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdc4995-139e-4b66-8a30-59fa594820c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (8b002be3-cfae-49f7-b31f-c66b6cda81a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8d525b90-b3d6-4cbd-8d29-7b701e9d7895" released by "delete_volume" :: held 1.771s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-139f8bc3-1d53-456b-a9bf-845730ae5e4a tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Created reservations ['8eb3d60f-30a7-43ae-b1b3-4e06a3972a33', '57bb4a34-8fb8-4d41-b888-83b86a3e6373', '8c250b74-f3da-4562-a437-cd45e7b28c18', 'b29e368e-38a1-4a11-8d94-016f14d974d7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:36 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:36 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-6b9b0f55-02c1-4631-a2f4-071b7a2c5456-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "cinder-6b9b0f55-02c1-4631-a2f4-071b7a2c5456-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0375a3-4def-4add-b982-bfc578fa43b1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:37 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:37 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:37 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 1073741824" returned: 0 in 1.307s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:37 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.096s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:37 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:25:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fc63b2b4-4750-4598-aff9-1acf6b4d9c56 tempest-VolumesGetTest-241496992 None] Lock "cinder-8d525b90-b3d6-4cbd-8d29-7b701e9d7895-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:37 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 Jul 08 11:25:37 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:38 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 1.251s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:38 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456 Jul 08 11:25:38 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:38 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006" returned: 0 in 0.920s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.314s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098544105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eaea05-88af-424f-9581-ab6985e201a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c52083be024d3a9e90747a90198cdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:31Z,use_quota=True,user_id='3349c4b619e74330b853d95f3f2908f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Creating volume d7eaea05-88af-424f-9581-ab6985e201a8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:38 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527d2911-e71e-492b-afcc-36da3d43a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b5ca8c-053d-4043-a185-2fc165758006', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:38 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 1073741824 Jul 08 11:25:38 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4d97f-51de-4b7f-98dd-4a6a280479ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:38 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-46b5ca8c-053d-4043-a185-2fc165758006 (46b5ca8c-053d-4043-a185-2fc165758006): created successfully Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4d97f-51de-4b7f-98dd-4a6a280479ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (a3687641-d655-4952-b378-ffe75c531a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fbb93724-2c32-4f2d-a34a-d8d706a11bec tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:25:39 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" returned: 0 in 0.993s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-6b9b0f55-02c1-4631-a2f4-071b7a2c5456" released by "delete_volume" :: held 2.356s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Created reservations ['3bad9b6b-df24-4211-a139-605e4ff83716', '84a6f2ac-11bf-4409-90c6-ebfdcebdb827', '4a083a38-1989-4c9d-be0e-fdfcac1e599e', 'fe8f0621-f9f2-4e12-b808-977b803308f2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:39 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:39 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:39 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 1073741824" returned: 0 in 1.289s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:39 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 Jul 08 11:25:39 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:40 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.025s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-767eb7af-164c-4018-aa14-1c992e366769 tempest-VolumesGetTest-241496992 None] Lock "cinder-6b9b0f55-02c1-4631-a2f4-071b7a2c5456-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:40 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8" returned: 0 in 1.159s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.517s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b736037-0417-46f8-9806-ad524c5a8f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7eaea05-88af-424f-9581-ab6985e201a8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cceed09-4195-4b40-9e58-8da3abab36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:40 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Volume volume-d7eaea05-88af-424f-9581-ab6985e201a8 (d7eaea05-88af-424f-9581-ab6985e201a8): created successfully Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cceed09-4195-4b40-9e58-8da3abab36c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Flow 'volume_create_manager' (df8789d3-c059-4adb-8b57-48541dcfa88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0a590072-1252-438b-b6ba-7335521bc24c tempest-CreateVolumesFromSnapshotTest-144353888 None] Created volume successfully. Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (95b0e0ef-0146-48c3-b1e2-bef8dd371a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0ada41-3444-40ad-bffd-b966ff9e2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-d7eaea05-88af-424f-9581-ab6985e201a8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0ada41-3444-40ad-bffd-b966ff9e2504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1485247230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc41e1a-f3f2-49c6-b54a-439956845e3b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:41Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96aaf2c-23c5-4b47-9cae-150d12c9b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96aaf2c-23c5-4b47-9cae-150d12c9b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2225326-6f51-4161-ad4e-7307a4315db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-d7eaea05-88af-424f-9581-ab6985e201a8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-d7eaea05-88af-424f-9581-ab6985e201a8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-d7eaea05-88af-424f-9581-ab6985e201a8" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f185b7b5-fa0a-4d88-84c7-35cbd389374e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:41 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 Jul 08 11:25:41 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2225326-6f51-4161-ad4e-7307a4315db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bc41e1a-f3f2-49c6-b54a-439956845e3b', 'volume_name': 'volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47e47a9-426c-4a3f-b90f-5d1dd16ddf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47e47a9-426c-4a3f-b90f-5d1dd16ddf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6cc722-d59e-4058-87ed-40b244447a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 11:25:41 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Trying to clone 8bc41e1a-f3f2-49c6-b54a-439956845e3b from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:25:42 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:25:42 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Image download 20.69 MB at 20.69 MB/s Jul 08 11:25:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af5f570-4920-4280-b96f-5bfc736b72dc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:42 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD Jul 08 11:25:42 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:42 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8" returned: 0 in 1.027s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:42 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8 Jul 08 11:25:42 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:43 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 is fetched for user 066032b185f14e588d7876dd8f6d4862. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:25:43 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d7eaea05-88af-424f-9581-ab6985e201a8" returned: 0 in 0.740s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-d7eaea05-88af-424f-9581-ab6985e201a8" released by "delete_volume" :: held 1.826s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f0e10-4074-4524-a6e5-5a27d19b016a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['9edfa135-e67e-4063-afdf-59fcc0127e8b', '95036ee9-a622-4365-8858-5c9079161699', '98794b87-7c39-4c48-9ded-598a5d147493', 'e6bb2b59-48cf-4dff-ae0c-918e73c632de'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:43 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:43 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:43 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD Jul 08 11:25:43 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-46b5ca8c-053d-4043-a185-2fc165758006-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-46b5ca8c-053d-4043-a185-2fc165758006-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-46b5ca8c-053d-4043-a185-2fc165758006" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-46b5ca8c-053d-4043-a185-2fc165758006" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de944ab-74a0-4efa-af86-6b1a9aa25631]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:43 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 Jul 08 11:25:43 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:44 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD" returned: 0 in 1.023s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1485247230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc41e1a-f3f2-49c6-b54a-439956845e3b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:41Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Creating volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:44 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:44 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1073741824 Jul 08 11:25:44 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:44 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.013s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0882d9a-ef7f-4011-9302-bf959c131343 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-d7eaea05-88af-424f-9581-ab6985e201a8-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:44 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006" returned: 0 in 1.134s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:44 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006 Jul 08 11:25:44 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:45 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1073741824" returned: 0 in 1.216s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:45 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=126,cinder:SELECT=94,cinder:DELETE=13,cinder:INSERT=29 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:25:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:45 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:25:45 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:45 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-46b5ca8c-053d-4043-a185-2fc165758006" returned: 0 in 1.004s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-46b5ca8c-053d-4043-a185-2fc165758006" released by "delete_volume" :: held 2.228s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['8eb164d0-132b-48f6-977e-fe5664ed58e9', '568dd6d5-ecf0-4f45-a923-ba9d20dc3640', '92a3f022-c94d-471c-bb2c-8f10933bb1e0', '24dfb0ef-e724-4ee7-926e-bbf752fe8e36'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-f4d067fd-7e85-4948-ac62-9f2496701c16-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-f4d067fd-7e85-4948-ac62-9f2496701c16-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:46 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:46 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-quobyte-f4d067fd-7e85-4948-ac62-9f2496701c16" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-f4d067fd-7e85-4948-ac62-9f2496701c16" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d80c68-6c91-4f0d-8365-0ec58b47b063]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:46 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 0 in 0.843s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:46 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 Jul 08 11:25:46 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Attempting download of 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8e97e-e3d9-4f54-bd6f-71f8368030a9]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:46 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q Jul 08 11:25:46 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:46 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.819s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:46 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-837fffd0-3dcb-4df0-a4b3-3ff8c8bfcc53 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-46b5ca8c-053d-4043-a185-2fc165758006-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-c75ac908-3206-4887-b51b-2bfd08a6196b-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-c75ac908-3206-4887-b51b-2bfd08a6196b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-c75ac908-3206-4887-b51b-2bfd08a6196b" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-c75ac908-3206-4887-b51b-2bfd08a6196b" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[311019aa-47fc-4bbe-9ce4-538ed865ba80]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:47 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b Jul 08 11:25:47 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:47 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16" returned: 0 in 1.181s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:47 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q" returned: 0 in 0.968s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:47 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16 Jul 08 11:25:47 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:47 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q Jul 08 11:25:47 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:48 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b" returned: 0 in 1.049s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:48 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f4d067fd-7e85-4948-ac62-9f2496701c16" returned: 0 in 0.870s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:48 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b Jul 08 11:25:48 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-f4d067fd-7e85-4948-ac62-9f2496701c16" released by "delete_volume" :: held 2.113s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Created reservations ['cb51f24f-d717-424a-8f99-b28c13dc998b', '47748d28-33d6-43b0-a369-716dd8acc47b', 'cc8b8cc6-3771-43ca-8130-206329ff73d7', '41d2c769-6979-4ab5-9336-27eb2f135889'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:48 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q" returned: 1 in 1.064s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_5cexlh4q' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9100c8-9dda-4992-9269-8e16361b20ce]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:48 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:48 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:48 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD Jul 08 11:25:48 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:49 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c75ac908-3206-4887-b51b-2bfd08a6196b" returned: 0 in 0.768s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-c75ac908-3206-4887-b51b-2bfd08a6196b" released by "delete_volume" :: held 1.906s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['852478d4-d4ae-409b-a622-a885e1d40852', '1ec56a55-1f67-484b-8a01-3fb65966bb8d', 'a5882a65-bb0b-4138-b890-de2bbc6274d1', '984e53fc-288d-417a-92d1-6c590fdc80ec'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:49 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:49 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:49 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.806s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Deleted volume successfully. Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0de0276a-fda0-4558-9fb9-d5bf1246e39f tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-f4d067fd-7e85-4948-ac62-9f2496701c16-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-9e397da0-afd6-4442-b127-245fe96fe1b1-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-9e397da0-afd6-4442-b127-245fe96fe1b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-9e397da0-afd6-4442-b127-245fe96fe1b1" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-9e397da0-afd6-4442-b127-245fe96fe1b1" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:49 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD" returned: 0 in 1.014s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] 9c13436c-39fd-4e1e-9478-9ae05ec64994 was qcow2, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf3444-dca4-4bec-940e-16980b072cf6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:49 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:25:49 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-c1e1b0ff-2006-4dec-a98c-e72164753074-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-c1e1b0ff-2006-4dec-a98c-e72164753074-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:49 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 Jul 08 11:25:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-quobyte-c1e1b0ff-2006-4dec-a98c-e72164753074" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-c1e1b0ff-2006-4dec-a98c-e72164753074" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4571ac0-0a04-4025-a443-606e3597da97]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:50 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 Jul 08 11:25:50 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:50 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.961s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:50 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:25:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f5656657-5274-4079-a6fc-f57ea746575d tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-c75ac908-3206-4887-b51b-2bfd08a6196b-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:50 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1" returned: 0 in 1.198s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:50 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1 Jul 08 11:25:50 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:51 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074" returned: 0 in 1.304s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:51 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074 Jul 08 11:25:51 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:51 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9e397da0-afd6-4442-b127-245fe96fe1b1" returned: 0 in 1.091s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-9e397da0-afd6-4442-b127-245fe96fe1b1" released by "delete_volume" :: held 2.371s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['84a8e3b1-3332-422d-8b49-d8f700d9bd62', '82fd0a8f-aeba-485b-9e06-24c2d5a6d6df', '78860b62-4f81-4d92-b051-108bf6cc4c5d', '1c35c71d-1764-4d64-b3c6-26651d24c475'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:52 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c1e1b0ff-2006-4dec-a98c-e72164753074" returned: 0 in 0.852s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-c1e1b0ff-2006-4dec-a98c-e72164753074" released by "delete_volume" :: held 2.244s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:52 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:52 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Created reservations ['4426d39e-70ac-405b-abe7-377ea40ab11d', 'afde0b8e-fd76-4a85-81ac-528acfc97bda', '2d3792b7-31e7-4dd9-98cd-245f3d395421', 'ccb2bbe9-4c94-431a-92b7-79ae53f25fb9'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:52 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:52 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:52 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:52 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 0 in 2.842s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_a1oufi_cdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:25:52 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Converted 112.00 MB image at 39.38 MB/s Jul 08 11:25:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:52 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1G Jul 08 11:25:52 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-b14313e7-c3a7-4cfb-9eed-515a3eda54da-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:53 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.820s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-b14313e7-c3a7-4cfb-9eed-515a3eda54da-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 28 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-b14313e7-c3a7-4cfb-9eed-515a3eda54da" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-b14313e7-c3a7-4cfb-9eed-515a3eda54da" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:53 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:53 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.147s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.963s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[78858e75-1d8d-4a2c-98ce-99d55a300ea4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b3dd8970-c827-4d34-bf2b-c530f44266d0 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-9e397da0-afd6-4442-b127-245fe96fe1b1-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Deleted volume successfully. Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c363b76d-864d-439d-99c9-080f7956b936 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-c1e1b0ff-2006-4dec-a98c-e72164753074-delete_volume" released by "delete_volume" :: held 3.573s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:53 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da Jul 08 11:25:53 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-b893ebcb-8fa0-407d-80be-fbd25a64cb2d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-b893ebcb-8fa0-407d-80be-fbd25a64cb2d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "cinder-quobyte-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:53 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fabbca-728a-499b-988b-11ef8e14a701]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b 1G" returned: 0 in 1.348s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861576a-268b-4ece-b0f6-798e162b07fc]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:53 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d Jul 08 11:25:53 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:53 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:25:53 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:54 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da" returned: 0 in 0.879s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:54 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da Jul 08 11:25:54 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:54 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" returned: 0 in 0.926s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:54 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d Jul 08 11:25:54 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:54 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 0 in 1.024s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:54 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b14313e7-c3a7-4cfb-9eed-515a3eda54da" returned: 0 in 0.775s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-b14313e7-c3a7-4cfb-9eed-515a3eda54da" released by "delete_volume" :: held 1.732s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:55 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:25:55 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['abf3cd34-d0a0-49dc-864e-9383f76f485a', 'a24bdbde-0a6f-431d-9439-20acd6fb0a3e', '7caaa1eb-1b97-4166-8888-6d3d0b6e5e10', '3ed9812b-4461-4890-99b8-d683cc77ec27'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:55 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:55 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-0713870c-71ba-4e05-9a84-b00415e34f4c-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-0713870c-71ba-4e05-9a84-b00415e34f4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:55 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" returned: 0 in 0.845s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-0713870c-71ba-4e05-9a84-b00415e34f4c" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-quobyte-b893ebcb-8fa0-407d-80be-fbd25a64cb2d" released by "delete_volume" :: held 1.839s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-0713870c-71ba-4e05-9a84-b00415e34f4c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleting offline snapshot 0713870c-71ba-4e05-9a84-b00415e34f4c of volume 29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] snapshot_file for this snap is: volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb5272d-74e7-44b5-b945-3b7a8f1564f2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Created reservations ['8f188ad9-c825-4001-bbfb-0abc1f92f683', 'dca4f988-490c-4899-b62a-9dba769e6c6b', '9d179624-c7f8-4dcd-93f4-c382ff07b453', '159db4ef-1fc2-4e61-b9fd-bc92ef5bf44b'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:55 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 1 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Downloaded image 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:25:55 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c Jul 08 11:25:55 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 for user 066032b185f14e588d7876dd8f6d4862 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Marking volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:25:55 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:25:55 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Copying metadata from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 to 8bc41e1a-f3f2-49c6-b54a-439956845e3b. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:25:55 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Creating volume glance metadata for volume 8bc41e1a-f3f2-49c6-b54a-439956845e3b backed by image 9c13436c-39fd-4e1e-9478-9ae05ec64994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6cc722-d59e-4058-87ed-40b244447a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ad2f2f-4d08-4b92-b6e9-199f36014c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.972s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Volume volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b (8bc41e1a-f3f2-49c6-b54a-439956845e3b): created successfully Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ad2f2f-4d08-4b92-b6e9-199f36014c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (95b0e0ef-0146-48c3-b1e2-bef8dd371a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fb9a740d-7f66-43f4-b66d-98a2705d66e2 tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4be2138b-223b-46ed-8a8b-d4c264b978d9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-b14313e7-c3a7-4cfb-9eed-515a3eda54da-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (a6ed2b0d-8f6f-4bb2-b930-930f30b0ad8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeac628-1bc2-4309-a699-9445fee54fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daeac628-1bc2-4309-a699-9445fee54fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1051301375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bbf762-0c9b-4456-9aef-226e95b9b39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:56Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f54072cc-cde1-43ca-af9a-e4c34736113b),volume_type_id=f54072cc-cde1-43ca-af9a-e4c34736113b)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafdd2ba-ba76-4c90-b521-caba6bf42b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafdd2ba-ba76-4c90-b521-caba6bf42b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736a0d9e-ae63-4437-adda-bb7d254e0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736a0d9e-ae63-4437-adda-bb7d254e0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bbf762-0c9b-4456-9aef-226e95b9b39d', 'volume_name': 'volume-96bbf762-0c9b-4456-9aef-226e95b9b39d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786b587-c572-45de-9257-40ca777cf996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786b587-c572-45de-9257-40ca777cf996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c51f5e8-a259-4abf-bb8a-c48f7033c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume 96bbf762-0c9b-4456-9aef-226e95b9b39d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bbf762-0c9b-4456-9aef-226e95b9b39d', 'volume_size': 1} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1051301375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bbf762-0c9b-4456-9aef-226e95b9b39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:56Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f54072cc-cde1-43ca-af9a-e4c34736113b),volume_type_id=f54072cc-cde1-43ca-af9a-e4c34736113b)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Creating volume 96bbf762-0c9b-4456-9aef-226e95b9b39d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:56 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d 1073741824 Jul 08 11:25:56 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:56 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.025s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:25:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Deleted volume successfully. Jul 08 11:25:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8bf508b1-1b41-4d30-a4e1-b4655edddcc3 tempest-AttachVolumeNegativeTest-1942800585 None] Lock "cinder-b893ebcb-8fa0-407d-80be-fbd25a64cb2d-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:25:57 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c" returned: 0 in 1.350s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29672e7e-9ccb-47ce-8990-1446c08f1582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[10021695-28c3-47a4-980c-7ac9ad886cf8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (818e3725-0c91-4667-9c32-a3c6e86d9eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532cd777-22dd-41f5-a01f-b19f1a78fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:57 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 Jul 08 11:25:57 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532cd777-22dd-41f5-a01f-b19f1a78fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-711432757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e84d33-5c82-4163-bd17-e5889144b89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:57Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e820efc-7512-42c8-9d76-0dbc625815b9),volume_type_id=0e820efc-7512-42c8-9d76-0dbc625815b9)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf6ad6c-95c4-4c6e-b0f1-7bf81661162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf6ad6c-95c4-4c6e-b0f1-7bf81661162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e646f65-9954-46f7-8b36-c135d369407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e646f65-9954-46f7-8b36-c135d369407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e84d33-5c82-4163-bd17-e5889144b89f', 'volume_name': 'volume-e6e84d33-5c82-4163-bd17-e5889144b89f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362e45a-413c-476d-8ade-47ee0b15a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362e45a-413c-476d-8ade-47ee0b15a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6388a6-a073-4b32-ae24-67cfa53c6f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:57 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume e6e84d33-5c82-4163-bd17-e5889144b89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e84d33-5c82-4163-bd17-e5889144b89f', 'volume_size': 1} Jul 08 11:25:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:58 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d 1073741824" returned: 0 in 1.415s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:58 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d Jul 08 11:25:58 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (291b862b-7412-4425-a9cf-11edf98023a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e24014-707c-4235-acc5-86adb82ea002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e24014-707c-4235-acc5-86adb82ea002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290908528',display_name='tempest-VolumesGetTest-Volume-1230130987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec29c83f-831e-4360-9d39-620e832994c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:58Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d52cbbb-4140-4105-9deb-abe259aadffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d52cbbb-4140-4105-9deb-abe259aadffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a292e766-1bdd-4bea-a1d0-7bf05c1fd055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a292e766-1bdd-4bea-a1d0-7bf05c1fd055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec29c83f-831e-4360-9d39-620e832994c2', 'volume_name': 'volume-ec29c83f-831e-4360-9d39-620e832994c2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd738d83-6baf-4728-9069-7b5c48510849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd738d83-6baf-4728-9069-7b5c48510849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce49f50-824d-409b-a80f-cad76487da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Volume ec29c83f-831e-4360-9d39-620e832994c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec29c83f-831e-4360-9d39-620e832994c2', 'volume_size': 1} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (25102fff-eeb3-4341-bc60-c0a93a1b4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6004946-c69c-4904-b87c-a2fd93099e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6004946-c69c-4904-b87c-a2fd93099e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-81152111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab98b71-d882-4cf9-9ae3-31032f775714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:58Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd1d8cb-e78e-4acf-9047-9863746204b6),volume_type_id=1cd1d8cb-e78e-4acf-9047-9863746204b6)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad1091f-f550-4c78-b0c3-857f359838c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad1091f-f550-4c78-b0c3-857f359838c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718052c-70bd-444e-a6ad-180fc100c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582" returned: 0 in 1.309s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:58 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c Jul 08 11:25:58 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7718052c-70bd-444e-a6ad-180fc100c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fab98b71-d882-4cf9-9ae3-31032f775714', 'volume_name': 'volume-fab98b71-d882-4cf9-9ae3-31032f775714', 'volume_size': 1, 'image_id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--246895421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc9571c56b474de4b9fce4c0fb4dfc4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'created_at': datetime.datetime(2026, 7, 8, 9, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 25, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbd3a2a-4ade-4d40-a211-a60949f4fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbd3a2a-4ade-4d40-a211-a60949f4fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e285e-e449-44e0-9891-2e8cf9321e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume fab98b71-d882-4cf9-9ae3-31032f775714: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fab98b71-d882-4cf9-9ae3-31032f775714', 'volume_size': 1, 'image_id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--246895421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc9571c56b474de4b9fce4c0fb4dfc4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'created_at': datetime.datetime(2026, 7, 8, 9, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 25, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4/file', 'properties': {}}, 'image_service': } Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Trying to clone fab98b71-d882-4cf9-9ae3-31032f775714 from image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:25:58 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d" returned: 0 in 0.809s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-711432757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e84d33-5c82-4163-bd17-e5889144b89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:57Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e820efc-7512-42c8-9d76-0dbc625815b9),volume_type_id=0e820efc-7512-42c8-9d76-0dbc625815b9)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Creating volume e6e84d33-5c82-4163-bd17-e5889144b89f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:25:58 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:25:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:59 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f 1073741824 Jul 08 11:25:59 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c51f5e8-a259-4abf-bb8a-c48f7033c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bbf762-0c9b-4456-9aef-226e95b9b39d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732702a9-f3ad-4e3d-b3e9-007dc1ce5e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:25:59 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume volume-96bbf762-0c9b-4456-9aef-226e95b9b39d (96bbf762-0c9b-4456-9aef-226e95b9b39d): created successfully Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732702a9-f3ad-4e3d-b3e9-007dc1ce5e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (a6ed2b0d-8f6f-4bb2-b930-930f30b0ad8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:25:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-40ba662b-fa28-4250-99ce-27f636f42ee4 tempest-TestInstancesWithCinderVolumes-1039527798 None] Created volume successfully. Jul 08 11:25:59 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c" returned: 0 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:25:59 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c Jul 08 11:25:59 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:25:59 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 08 11:25:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f 1073741824" returned: 0 in 0.969s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:00 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f Jul 08 11:26:00 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:00 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582.0713870c-71ba-4e05-9a84-b00415e34f4c" returned: 0 in 0.881s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-0713870c-71ba-4e05-9a84-b00415e34f4c" released by "_delete_snapshot" :: held 4.700s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" released by "delete_snapshot" :: held 4.738s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['631b154e-8529-42a7-b3bc-ff9dc470a9cf', '9de06e35-e543-43b2-9679-465049877c8e', '32d15094-d8b8-4c11-8007-79fc907008df', '28892e56-e8b3-4c03-8fe4-dfdd793c0963'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Delete snapshot completed successfully. Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ac4eeba-38c4-43d2-b07e-d6ba18647cf9 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-0713870c-71ba-4e05-9a84-b00415e34f4c-delete_snapshot" released by "delete_snapshot" :: held 5.028s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:00 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290908528',display_name='tempest-VolumesGetTest-Volume-1230130987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec29c83f-831e-4360-9d39-620e832994c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e49eda16ae4b36bf3a303d06bafddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:58Z,use_quota=True,user_id='066032b185f14e588d7876dd8f6d4862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Creating volume ec29c83f-831e-4360-9d39-620e832994c2 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:00 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:00 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 1073741824 Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6388a6-a073-4b32-ae24-67cfa53c6f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e84d33-5c82-4163-bd17-e5889144b89f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:00 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffda1cc-c697-4219-960f-6d1a08f8c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume volume-e6e84d33-5c82-4163-bd17-e5889144b89f (e6e84d33-5c82-4163-bd17-e5889144b89f): created successfully Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffda1cc-c697-4219-960f-6d1a08f8c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (818e3725-0c91-4667-9c32-a3c6e86d9eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2ed86d9d-8574-4e99-b76a-a2f97393a4d2 tempest-TestInstancesWithCinderVolumes-1039527798 None] Created volume successfully. Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-29672e7e-9ccb-47ce-8990-1446c08f1582-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-29672e7e-9ccb-47ce-8990-1446c08f1582-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[99619f17-f98b-4542-8e94-3248a4421c63]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:01 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 Jul 08 11:26:01 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:01 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 1073741824" returned: 0 in 1.094s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:02 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 Jul 08 11:26:02 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:02 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582" returned: 0 in 1.074s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:02 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582 Jul 08 11:26:02 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:02 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2" returned: 0 in 0.842s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce49f50-824d-409b-a80f-cad76487da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec29c83f-831e-4360-9d39-620e832994c2', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ae80c0-a61a-49a3-a64d-11859caf03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Volume volume-ec29c83f-831e-4360-9d39-620e832994c2 (ec29c83f-831e-4360-9d39-620e832994c2): created successfully Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ae80c0-a61a-49a3-a64d-11859caf03b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Flow 'volume_create_manager' (291b862b-7412-4425-a9cf-11edf98023a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-00d3093b-e8df-41dc-bd17-308aa713b06a tempest-VolumesGetTest-241496992 None] Created volume successfully. Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD, size 20.69 MB, duration 4.39 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:26:03 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Image download 20.69 MB at 4.71 MB/s Jul 08 11:26:03 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-29672e7e-9ccb-47ce-8990-1446c08f1582" returned: 0 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1685d68-9e61-497b-bd17-df8d49b30310]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-quobyte-29672e7e-9ccb-47ce-8990-1446c08f1582" released by "delete_volume" :: held 1.975s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Created reservations ['75fbf51a-52f2-4730-a6c9-9662637ba497', '80bb44d0-b14d-4351-a134-9282ab9cb8d1', '479efbc4-8286-43c0-85c2-9f4be710dd15', 'e0c75ce9-0201-49d2-9f76-36a0f755129f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:03 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD Jul 08 11:26:03 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:03 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:03 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-ec29c83f-831e-4360-9d39-620e832994c2-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "cinder-ec29c83f-831e-4360-9d39-620e832994c2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-ec29c83f-831e-4360-9d39-620e832994c2" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-ec29c83f-831e-4360-9d39-620e832994c2" acquired by "delete_volume" :: waited 0.044s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aafb7c-fac7-41d9-8754-a2f0f41c59e4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:03 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 Jul 08 11:26:03 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:04 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.038s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:04 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Deleted volume successfully. Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD" returned: 0 in 1.236s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Temporary image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 is fetched for user 343eac56e383403ca2a57b5febf3a423. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2b162463-5bd7-4fee-acd0-41536c11ebc7 tempest-CreateVolumesFromSnapshotTest-144353888 None] Lock "cinder-29672e7e-9ccb-47ce-8990-1446c08f1582-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a6ec4e-b3d8-45e5-bc4c-a3a2bd443cda]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:04 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD Jul 08 11:26:04 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:05 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2" returned: 0 in 1.233s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:05 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2 Jul 08 11:26:05 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:05 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-81152111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab98b71-d882-4cf9-9ae3-31032f775714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9571c56b474de4b9fce4c0fb4dfc4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:25:58Z,use_quota=True,user_id='343eac56e383403ca2a57b5febf3a423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cd1d8cb-e78e-4acf-9047-9863746204b6),volume_type_id=1cd1d8cb-e78e-4acf-9047-9863746204b6)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Creating volume fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:05 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:05 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1073741824 Jul 08 11:26:05 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:05 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ec29c83f-831e-4360-9d39-620e832994c2" returned: 0 in 0.774s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-ec29c83f-831e-4360-9d39-620e832994c2" released by "delete_volume" :: held 2.116s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Flow 'volume_create_manager' (5d788b83-c36b-4801-884a-8cdbe9adabbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb3f49d-913b-46f0-bbdd-ad60e14abb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb3f49d-913b-46f0-bbdd-ad60e14abb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-555142114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90622109-f8a1-47cc-ada0-4f15282e4fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc0ed597194a4e9906e50b298c57b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:06Z,use_quota=True,user_id='5e9918d6a044423ebe7f32828548cdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e7631d-ffb1-417e-a246-c7af9c8fee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e7631d-ffb1-417e-a246-c7af9c8fee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651302e0-4d47-4e65-b8c0-1c78a2389166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651302e0-4d47-4e65-b8c0-1c78a2389166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90622109-f8a1-47cc-ada0-4f15282e4fcf', 'volume_name': 'volume-90622109-f8a1-47cc-ada0-4f15282e4fcf', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef987db-996a-47cd-a412-6ace8102b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef987db-996a-47cd-a412-6ace8102b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10220694-958d-4321-8015-e12d75d36922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Volume 90622109-f8a1-47cc-ada0-4f15282e4fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90622109-f8a1-47cc-ada0-4f15282e4fcf', 'volume_size': 1} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Created reservations ['c7884072-db37-4eb3-a891-df8c53b673f4', '55556ee8-e365-4796-aa54-b75f5ee0de3a', '6818aaab-aa29-4358-b7d9-184684253088', '42fb1d4c-0428-4aff-b5de-7f51312dd8ad'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:06 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:06 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:06 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1073741824" returned: 0 in 1.063s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:06 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:06 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:06 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.686s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:26:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3fb4cb80-a599-45ac-b858-08c1b3be1410 tempest-VolumesGetTest-241496992 None] Lock "cinder-ec29c83f-831e-4360-9d39-620e832994c2-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-8bc41e1a-f3f2-49c6-b54a-439956845e3b-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "cinder-8bc41e1a-f3f2-49c6-b54a-439956845e3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Acquiring lock "cinder-quobyte-8bc41e1a-f3f2-49c6-b54a-439956845e3b" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8bc41e1a-f3f2-49c6-b54a-439956845e3b" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dd0a7f-de37-4834-9ebf-8b140ec6a933]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:07 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 0.691s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-555142114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90622109-f8a1-47cc-ada0-4f15282e4fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc0ed597194a4e9906e50b298c57b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:06Z,use_quota=True,user_id='5e9918d6a044423ebe7f32828548cdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Creating volume 90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:07 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:07 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf 1073741824 Jul 08 11:26:07 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:07 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:26:07 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Attempting download of dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}])) to volume fab98b71-d882-4cf9-9ae3-31032f775714. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe70a84-81ed-4d11-b696-a0ea272919fd]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:07 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy Jul 08 11:26:07 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Flow 'volume_create_manager' (a5d949ef-fc50-4c44-b893-307186cb7746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80b74a-a01c-4b9e-962d-2e02e222ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b80b74a-a01c-4b9e-962d-2e02e222ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755146124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56053a9c-72c8-4296-af73-ab16e8365911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61e26cac7ad426698f00aa2be62ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:08Z,use_quota=True,user_id='4afa11354dd74721bd92a5496e3b6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0561fec3-fda6-4137-9e10-0248d07904d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0561fec3-fda6-4137-9e10-0248d07904d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea2e84-9848-4524-9be0-982532f9e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ea2e84-9848-4524-9be0-982532f9e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56053a9c-72c8-4296-af73-ab16e8365911', 'volume_name': 'volume-56053a9c-72c8-4296-af73-ab16e8365911', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaf4e81-2c89-435c-81d2-9223c8ae992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaf4e81-2c89-435c-81d2-9223c8ae992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece91904-3069-4206-9977-d0f924d6fcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Volume 56053a9c-72c8-4296-af73-ab16e8365911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56053a9c-72c8-4296-af73-ab16e8365911', 'volume_size': 1} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:08 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 0 in 0.899s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:08 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:26:08 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:08 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy" returned: 0 in 0.883s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:08 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf 1073741824" returned: 0 in 1.044s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:08 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy Jul 08 11:26:08 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:08 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf Jul 08 11:26:08 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:08 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 1 in 0.824s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:26:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:09 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b Jul 08 11:26:09 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:09 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755146124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56053a9c-72c8-4296-af73-ab16e8365911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61e26cac7ad426698f00aa2be62ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:08Z,use_quota=True,user_id='4afa11354dd74721bd92a5496e3b6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Creating volume 56053a9c-72c8-4296-af73-ab16e8365911 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:09 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:09 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy" returned: 1 in 0.784s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_rymkvmvy' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e993cc9-6a72-4307-be0b-7e105640e4ba]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:09 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 1073741824 Jul 08 11:26:09 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10220694-958d-4321-8015-e12d75d36922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90622109-f8a1-47cc-ada0-4f15282e4fcf', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d176150-1cf8-46f9-af24-af80d566e600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Volume volume-90622109-f8a1-47cc-ada0-4f15282e4fcf (90622109-f8a1-47cc-ada0-4f15282e4fcf): created successfully Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d176150-1cf8-46f9-af24-af80d566e600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Flow 'volume_create_manager' (5d788b83-c36b-4801-884a-8cdbe9adabbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-b53a179b-0b5f-43ae-b8ac-a6fb7de919f9 req-0ae4a526-28a3-4540-aa25-e26259c36ad9 tempest-VolumesSnapshotsTestJSON-1611446576 None] Created volume successfully. Jul 08 11:26:09 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD Jul 08 11:26:09 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:09 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bc41e1a-f3f2-49c6-b54a-439956845e3b" returned: 0 in 0.856s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "cinder-quobyte-8bc41e1a-f3f2-49c6-b54a-439956845e3b" released by "delete_volume" :: held 2.652s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:09 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Created reservations ['e75f76d8-32a1-4b9a-b0f9-0f16321c0218', '29016724-c540-422e-b8be-b485a4992f88', '95d210fa-850b-4620-9065-566622e0c318', '9108a6d3-073b-445c-b4ee-c4fc8e3be7f8'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:10 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:10 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:10 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 was qcow2, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:10 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:10 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:10 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 1073741824" returned: 0 in 1.062s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:10 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 Jul 08 11:26:10 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:10 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Deleted volume successfully. Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40775546-0fae-4d2c-8055-40d064265415 tempest-VolumesGetTest-241496992 None] Lock "cinder-8bc41e1a-f3f2-49c6-b54a-439956845e3b-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:10 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.359s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece91904-3069-4206-9977-d0f924d6fcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56053a9c-72c8-4296-af73-ab16e8365911', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0115c6-a07b-4f33-ab3c-e51df7804bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Creating offline snapshot bdbfe79e-7d26-47b5-816c-e949db59d161 of volume 90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:26:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Volume volume-56053a9c-72c8-4296-af73-ab16e8365911 (56053a9c-72c8-4296-af73-ab16e8365911): created successfully Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0115c6-a07b-4f33-ab3c-e51df7804bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Flow 'volume_create_manager' (a5d949ef-fc50-4c44-b893-307186cb7746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[08db6d91-29cb-4866-b8e3-e54753308c51]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-122993a7-9673-490b-b686-4b63cfcabae5 tempest-ProjectReaderTests-515838979 None] Created volume successfully. Jul 08 11:26:11 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf Jul 08 11:26:11 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Acquiring lock "cinder-56053a9c-72c8-4296-af73-ab16e8365911-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "cinder-56053a9c-72c8-4296-af73-ab16e8365911-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Acquiring lock "cinder-quobyte-56053a9c-72c8-4296-af73-ab16e8365911" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "cinder-quobyte-56053a9c-72c8-4296-af73-ab16e8365911" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd0f61-5be2-4767-b2c0-50838a9f5a78]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:11 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 Jul 08 11:26:11 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:12 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf" returned: 0 in 1.125s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:12 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 1G Jul 08 11:26:12 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:12 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 2.372s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4_u6l9i4dgdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:26:12 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Converted 112.00 MB image at 47.18 MB/s Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:12 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1G Jul 08 11:26:12 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:12 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911" returned: 0 in 1.148s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:12 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911 Jul 08 11:26:12 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:13 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 1G" returned: 0 in 0.976s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90622109-f8a1-47cc-ada0-4f15282e4fcf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:13 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90622109-f8a1-47cc-ada0-4f15282e4fcf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 Jul 08 11:26:13 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:13 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 1G" returned: 0 in 0.855s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da45b1-b7e6-407d-8ff4-937fa9ba686d]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:13 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:13 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:13 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-56053a9c-72c8-4296-af73-ab16e8365911" returned: 0 in 0.805s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "cinder-quobyte-56053a9c-72c8-4296-af73-ab16e8365911" released by "delete_volume" :: held 2.040s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Created reservations ['4c62e8a8-bbc6-4843-b6cc-ce3c92b4e0e1', '426ace53-7d1e-42d2-8c70-7013c9ffc7ee', '29303296-9636-48b0-80b6-35923194e1ec', '1aacb9be-f570-4488-bee6-7c646413f10e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:13 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:13 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:14 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90622109-f8a1-47cc-ada0-4f15282e4fcf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161" returned: 0 in 0.894s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:14 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 is being set with open permissions: ugo+rw Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:14 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 Jul 08 11:26:14 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (1d6f7b73-03f2-4927-a11e-bddbed5d7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9e91c4-0cb5-46ee-bd21-ee6e75bd1c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9e91c4-0cb5-46ee-bd21-ee6e75bd1c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1848605107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be43872c-ae96-4885-b5ee-01a56588d111,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:14Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7a304c-7ca8-4139-b1bc-1d8d0d123ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7a304c-7ca8-4139-b1bc-1d8d0d123ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b37d3c-7266-4ca3-aaa2-5b1819eebc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b37d3c-7266-4ca3-aaa2-5b1819eebc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be43872c-ae96-4885-b5ee-01a56588d111', 'volume_name': 'volume-be43872c-ae96-4885-b5ee-01a56588d111', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aa8c28-bd65-460d-bfa4-8d27a84e6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aa8c28-bd65-460d-bfa4-8d27a84e6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a224589-ba67-44a8-a224-f2d36cbb73c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:14 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Volume be43872c-ae96-4885-b5ee-01a56588d111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be43872c-ae96-4885-b5ee-01a56588d111', 'volume_size': 1} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:14 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 0.926s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:14 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:14 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:14 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Deleted volume successfully. Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d89fbfef-ca3f-42f8-9ac6-b4cb15c991b9 tempest-ProjectReaderTests-515838979 None] Lock "cinder-56053a9c-72c8-4296-af73-ab16e8365911-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:14 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161" returned: 0 in 0.713s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:14 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info Jul 08 11:26:14 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:15 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 1 in 0.803s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Downloaded image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}])) to volume fab98b71-d882-4cf9-9ae3-31032f775714 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Temporary image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 for user 343eac56e383403ca2a57b5febf3a423 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Marking volume fab98b71-d882-4cf9-9ae3-31032f775714 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Copying metadata from image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 to fab98b71-d882-4cf9-9ae3-31032f775714. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Creating volume glance metadata for volume fab98b71-d882-4cf9-9ae3-31032f775714 backed by image dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4 with: {'image_id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'image_name': 'tempest-scenario-img--246895421', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e285e-e449-44e0-9891-2e8cf9321e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab98b71-d882-4cf9-9ae3-31032f775714', 'volume_size': 1, 'image_id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--246895421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc9571c56b474de4b9fce4c0fb4dfc4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4', 'created_at': datetime.datetime(2026, 7, 8, 9, 25, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 25, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd027dfa-c7d4-475d-9ea1-ab2d8a6b6eb4/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d6d421-6c93-4a67-bdf3-fa1b169bbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Volume volume-fab98b71-d882-4cf9-9ae3-31032f775714 (fab98b71-d882-4cf9-9ae3-31032f775714): created successfully Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d6d421-6c93-4a67-bdf3-fa1b169bbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Flow 'volume_create_manager' (25102fff-eeb3-4341-bc60-c0a93a1b4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ab6dcbe9-780d-4888-8b64-b91900b343ff tempest-TestInstancesWithCinderVolumes-1039527798 None] Created volume successfully. Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Flow 'volume_create_manager' (0d18e1c7-36d8-4a82-9898-333fb5927da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c6abd4-77a0-42d7-855b-bc25096441af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c6abd4-77a0-42d7-855b-bc25096441af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334634466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ae995-b25d-4bc7-b395-fe924a41a69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61e26cac7ad426698f00aa2be62ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:15Z,use_quota=True,user_id='4afa11354dd74721bd92a5496e3b6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdef8d19-9dc1-43f1-9f1c-39dee90a2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdef8d19-9dc1-43f1-9f1c-39dee90a2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d48f528-abce-4337-b580-5ec7d2232aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d48f528-abce-4337-b580-5ec7d2232aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4ae995-b25d-4bc7-b395-fe924a41a69d', 'volume_name': 'volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed18844d-b023-4d07-9dac-86148962e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed18844d-b023-4d07-9dac-86148962e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c624f7-f704-447a-8f80-55ce16cf6844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Volume 4b4ae995-b25d-4bc7-b395-fe924a41a69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d', 'volume_size': 1} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info" returned: 0 in 0.759s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:15 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info is being set with open permissions: ugo+rw Jul 08 11:26:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:15 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info Jul 08 11:26:15 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:16 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.info" returned: 0 in 0.643s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1848605107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be43872c-ae96-4885-b5ee-01a56588d111,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:14Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Creating volume be43872c-ae96-4885-b5ee-01a56588d111 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:16 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:16 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 1073741824 Jul 08 11:26:16 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-713e6c9f-e474-4850-91dd-271370db71d5 req-2aa92839-832d-45f0-b9e3-a6c655845a60 tempest-VolumesSnapshotsTestJSON-1611446576 None] Create snapshot completed successfully Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "cinder-bdbfe79e-7d26-47b5-816c-e949db59d161-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-bdbfe79e-7d26-47b5-816c-e949db59d161-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "cinder-quobyte-bdbfe79e-7d26-47b5-816c-e949db59d161" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-bdbfe79e-7d26-47b5-816c-e949db59d161" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Deleting offline snapshot bdbfe79e-7d26-47b5-816c-e949db59d161 of volume 90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] snapshot_file for this snap is: volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b85667-20ea-4fb1-9292-c75fb6cc583b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:16 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 Jul 08 11:26:16 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:17 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 1073741824" returned: 0 in 0.982s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:17 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 Jul 08 11:26:17 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:17 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161" returned: 0 in 0.966s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90622109-f8a1-47cc-ada0-4f15282e4fcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016d8d5-9573-477b-93aa-018aef95a86c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:17 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf Jul 08 11:26:17 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:18 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111" returned: 0 in 0.781s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334634466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4ae995-b25d-4bc7-b395-fe924a41a69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e61e26cac7ad426698f00aa2be62ee9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:15Z,use_quota=True,user_id='4afa11354dd74721bd92a5496e3b6b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Creating volume 4b4ae995-b25d-4bc7-b395-fe924a41a69d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:18 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:18 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d 1073741824 Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a224589-ba67-44a8-a224-f2d36cbb73c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be43872c-ae96-4885-b5ee-01a56588d111', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:18 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffc2c29-547d-4c92-b777-dfc48c7932de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:INSERT=56,cinder:UPDATE=199,cinder:SELECT=132,cinder:DELETE=13 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:26:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Volume volume-be43872c-ae96-4885-b5ee-01a56588d111 (be43872c-ae96-4885-b5ee-01a56588d111): created successfully Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffc2c29-547d-4c92-b777-dfc48c7932de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (1d6f7b73-03f2-4927-a11e-bddbed5d7926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c0e38172-5a08-4c9b-959d-e3a74df84a95 tempest-VolumesListTestJSON-1066803268 None] Created volume successfully. Jul 08 11:26:18 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf" returned: 0 in 0.884s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:18 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 Jul 08 11:26:18 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:19 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d 1073741824" returned: 0 in 1.047s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:19 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d Jul 08 11:26:19 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (8015cdc9-c917-4816-b21a-8342fc5c1b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b80762d-7183-408e-ab58-6d65e4b88aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b80762d-7183-408e-ab58-6d65e4b88aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-961924960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c934cc-8d44-4c1c-a938-5c4ad47e6a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:19Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3316d5b9-145c-4296-9054-f888c061ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3316d5b9-145c-4296-9054-f888c061ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb4d842-a3dd-4917-9732-13fd7203fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb4d842-a3dd-4917-9732-13fd7203fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c934cc-8d44-4c1c-a938-5c4ad47e6a65', 'volume_name': 'volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47736a21-7b65-4cf1-8be3-9ee03ee56fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47736a21-7b65-4cf1-8be3-9ee03ee56fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b290b48-7a68-40ed-9831-767025af4198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Volume 90c934cc-8d44-4c1c-a938-5c4ad47e6a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65', 'volume_size': 1} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:19 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161" returned: 0 in 0.874s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:19 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161 Jul 08 11:26:19 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:19 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d" returned: 0 in 0.692s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-961924960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c934cc-8d44-4c1c-a938-5c4ad47e6a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:19Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Creating volume 90c934cc-8d44-4c1c-a938-5c4ad47e6a65 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:19 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c624f7-f704-447a-8f80-55ce16cf6844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 1073741824 Jul 08 11:26:19 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef623601-f874-4ef0-8b94-3908243a2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Volume volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d (4b4ae995-b25d-4bc7-b395-fe924a41a69d): created successfully Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef623601-f874-4ef0-8b94-3908243a2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Flow 'volume_create_manager' (0d18e1c7-36d8-4a82-9898-333fb5927da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3ad4d7c4-f80b-41f2-a404-33efeda78497 tempest-ProjectReaderTests-515838979 None] Created volume successfully. Jul 08 11:26:20 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf.bdbfe79e-7d26-47b5-816c-e949db59d161" returned: 0 in 0.727s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-bdbfe79e-7d26-47b5-816c-e949db59d161" released by "_delete_snapshot" :: held 3.591s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" released by "delete_snapshot" :: held 3.624s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.quota [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Created reservations ['c764b45d-5fd7-4526-908e-d9e6941c6947', '1675a56b-f8e8-4283-8bfe-935442fa5285', '2922ee45-1a77-4601-a6c2-5628e5509696', '166ca94f-bf7f-4d62-aa7b-99a5b24fbf8d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Delete snapshot completed successfully. Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-59a0be81-d596-4925-8d47-f8537bbd525a req-c6cf844f-5d67-4127-9376-74c5c28ab011 tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-bdbfe79e-7d26-47b5-816c-e949db59d161-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:20 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 1073741824" returned: 0 in 0.854s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Acquiring lock "cinder-4b4ae995-b25d-4bc7-b395-fe924a41a69d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:20 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 Jul 08 11:26:20 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "cinder-4b4ae995-b25d-4bc7-b395-fe924a41a69d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Acquiring lock "cinder-quobyte-4b4ae995-b25d-4bc7-b395-fe924a41a69d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "cinder-quobyte-4b4ae995-b25d-4bc7-b395-fe924a41a69d" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f9930-e48f-46ba-bae7-594fb87cd3a0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:21 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d Jul 08 11:26:21 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "cinder-90622109-f8a1-47cc-ada0-4f15282e4fcf-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-90622109-f8a1-47cc-ada0-4f15282e4fcf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[13290c76-8910-4b19-8695-1ef49c4f87ee]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:21 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf Jul 08 11:26:21 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:21 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" returned: 0 in 0.731s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b290b48-7a68-40ed-9831-767025af4198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4116c7-9418-4fdf-9b2c-d5d0b6efb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Volume volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 (90c934cc-8d44-4c1c-a938-5c4ad47e6a65): created successfully Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4116c7-9418-4fdf-9b2c-d5d0b6efb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (8015cdc9-c917-4816-b21a-8342fc5c1b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6afe5d16-3d82-4f23-9ff7-1956941ad90c tempest-VolumesListTestJSON-1066803268 None] Created volume successfully. Jul 08 11:26:21 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d" returned: 0 in 0.878s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:21 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d Jul 08 11:26:21 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:22 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:22 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf Jul 08 11:26:22 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:22 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4b4ae995-b25d-4bc7-b395-fe924a41a69d" returned: 0 in 0.730s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "cinder-quobyte-4b4ae995-b25d-4bc7-b395-fe924a41a69d" released by "delete_volume" :: held 1.676s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Created reservations ['d030c516-152b-4898-8933-0c39818bdfa5', '7e34abb9-2145-49c4-9eae-ad0957aa748d', 'bc05af0a-b777-4389-9e0c-9402002284ca', 'db74d9e7-c731-44db-a522-8b91e9250dbc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:22 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:22 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:22 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90622109-f8a1-47cc-ada0-4f15282e4fcf" returned: 0 in 0.729s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-quobyte-90622109-f8a1-47cc-ada0-4f15282e4fcf" released by "delete_volume" :: held 1.619s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.quota [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Created reservations ['fd183d80-1479-4f9a-b2b5-f163228b8e20', 'f625d2f6-695b-4809-8411-7cf3763dea83', '1d081564-178d-4e5c-b353-95fb88a588e3', 'f7faa6ab-3070-4b91-bc5b-2abe5db21916'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (5be8db35-b502-4e53-bb61-4a85cb80f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f19662-1117-4d31-8262-3429d0be38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f19662-1117-4d31-8262-3429d0be38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-960631048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639bc391-1988-4d98-8b4f-9ca37aa3c27a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:23Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a047ccf-6eee-4218-aa11-c97cb1563921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a047ccf-6eee-4218-aa11-c97cb1563921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c056a2bd-46a7-43e6-91d5-99671b28a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c056a2bd-46a7-43e6-91d5-99671b28a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639bc391-1988-4d98-8b4f-9ca37aa3c27a', 'volume_name': 'volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81391c06-8d9f-4381-bdb4-0b80d9d82b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81391c06-8d9f-4381-bdb4-0b80d9d82b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869305f6-c0aa-4f43-83d0-20afd6702439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:23 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Volume 639bc391-1988-4d98-8b4f-9ca37aa3c27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a', 'volume_size': 1} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-960631048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639bc391-1988-4d98-8b4f-9ca37aa3c27a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d8b6c3165b6469398290e1bc7b81d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:23Z,use_quota=True,user_id='cbceabf54b79486e8a6e851c62d1fdd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Creating volume 639bc391-1988-4d98-8b4f-9ca37aa3c27a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:23 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:23 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a 1073741824 Jul 08 11:26:23 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:23 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:23 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:23 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.821s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:23 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Deleted volume successfully. Jul 08 11:26:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d1caf12c-21fb-4732-8c99-2f29f1334335 tempest-ProjectReaderTests-515838979 None] Lock "cinder-4b4ae995-b25d-4bc7-b395-fe924a41a69d-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:24 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.090s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:24 devstack cinder-volume[86852]: DEBUG cinder.manager [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Deleted volume successfully. Jul 08 11:26:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [req-e7152985-7383-4dcb-80c0-6f39f3ba7122 req-d6fb2bd4-3626-4671-9443-d42e2c28be6e tempest-VolumesSnapshotsTestJSON-1611446576 None] Lock "cinder-90622109-f8a1-47cc-ada0-4f15282e4fcf-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:24 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a 1073741824" returned: 0 in 1.427s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:24 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a Jul 08 11:26:24 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:25 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a" returned: 0 in 0.901s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.397s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869305f6-c0aa-4f43-83d0-20afd6702439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adaa7afb-04ef-46e9-8a1c-257e66d98ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f297e-c255-49bb-a561-b88b4fd17965]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Volume volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a (639bc391-1988-4d98-8b4f-9ca37aa3c27a): created successfully Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adaa7afb-04ef-46e9-8a1c-257e66d98ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Flow 'volume_create_manager' (5be8db35-b502-4e53-bb61-4a85cb80f856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-901a0669-899d-46db-8a8b-52a2cf99de51 tempest-VolumesListTestJSON-1066803268 None] Created volume successfully. Jul 08 11:26:25 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:25 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:26 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 1.121s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:26 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:26:26 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:27 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 1 in 1.002s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:26:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.176s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-fab98b71-d882-4cf9-9ae3-31032f775714', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2500d7fc-4dce-4871-baaa-befc0c391365', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:26:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-7a30b6e9-74a0-4851-bf12-9ba59af9b283 req-284cdb31-395e-4c74-9a6a-667d019e312c tempest-TestInstancesWithCinderVolumes-1039527798 None] attachment_update completed successfully. Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-639bc391-1988-4d98-8b4f-9ca37aa3c27a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-639bc391-1988-4d98-8b4f-9ca37aa3c27a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-quobyte-639bc391-1988-4d98-8b4f-9ca37aa3c27a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-639bc391-1988-4d98-8b4f-9ca37aa3c27a" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3941c770-3e71-436c-83a3-32ce341295e2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:29 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a Jul 08 11:26:29 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:30 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d8f58204-f45a-432d-8716-f099a0e7a497 tempest-GroupsV314Test-147365702 None] Group tempest-GroupsV314Test-Group-226727527: creating Jul 08 11:26:30 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d8f58204-f45a-432d-8716-f099a0e7a497 tempest-GroupsV314Test-147365702 None] Group tempest-GroupsV314Test-Group-226727527: created successfully Jul 08 11:26:30 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d8f58204-f45a-432d-8716-f099a0e7a497 tempest-GroupsV314Test-147365702 None] Create group completed successfully. Jul 08 11:26:30 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a" returned: 0 in 0.973s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:30 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a Jul 08 11:26:30 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:31 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-639bc391-1988-4d98-8b4f-9ca37aa3c27a" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-639bc391-1988-4d98-8b4f-9ca37aa3c27a" released by "delete_volume" :: held 1.738s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Created reservations ['b439fd92-4248-4beb-915c-30866c436c45', '00c17e1c-6deb-463f-914e-748e674a65af', '061a4e5c-4e37-4218-9d02-035e7e138fc6', 'abea2214-8f5e-4e8e-b41d-bba361007198'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:31 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:31 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-90c934cc-8d44-4c1c-a938-5c4ad47e6a65-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-90c934cc-8d44-4c1c-a938-5c4ad47e6a65-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-quobyte-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" acquired by "delete_volume" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[12709e4c-3cf8-42d9-8c2e-1e7a1f84b9b5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:32 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 Jul 08 11:26:32 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Flow 'volume_create_manager' (5ce2ac0e-e08f-4bea-a1c2-206609ba4566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f5ec5b-365e-4272-b338-b8ed0b2f4cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f5ec5b-365e-4272-b338-b8ed0b2f4cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747158511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ebdd243-b4b0-4ad5-b55d-fb6dcd85b000,host='devstack@QuobyteHD#QuobyteHD',id=11f4773f-4e65-428c-946a-81e3a509d165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6d5f1c840441ce86b2a387d6476a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:32Z,use_quota=True,user_id='2c4635563b21450cab8e43e98d47ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(832a5ba1-2f5f-4dc7-acb9-fb1767cf36d2),volume_type_id=832a5ba1-2f5f-4dc7-acb9-fb1767cf36d2)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2aa5b6-a0e0-45c3-8b82-64c44c759653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2aa5b6-a0e0-45c3-8b82-64c44c759653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e56a65-f08f-4d88-b74d-95640839d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e56a65-f08f-4d88-b74d-95640839d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f4773f-4e65-428c-946a-81e3a509d165', 'volume_name': 'volume-11f4773f-4e65-428c-946a-81e3a509d165', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b829ae-d585-4d43-a395-0305551c20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b829ae-d585-4d43-a395-0305551c20a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be29fb2-d6a4-48c3-b843-d542b67c188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:32 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Volume 11f4773f-4e65-428c-946a-81e3a509d165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f4773f-4e65-428c-946a-81e3a509d165', 'volume_size': 1} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ebdd243-b4b0-4ad5-b55d-fb6dcd85b000,created_at=2026-07-08T09:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747158511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ebdd243-b4b0-4ad5-b55d-fb6dcd85b000,host='devstack@QuobyteHD#QuobyteHD',id=11f4773f-4e65-428c-946a-81e3a509d165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6d5f1c840441ce86b2a387d6476a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:32Z,use_quota=True,user_id='2c4635563b21450cab8e43e98d47ee5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(832a5ba1-2f5f-4dc7-acb9-fb1767cf36d2),volume_type_id=832a5ba1-2f5f-4dc7-acb9-fb1767cf36d2)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Creating volume 11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:32 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:32 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.381s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:32 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 1073741824 Jul 08 11:26:32 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Deleted volume successfully. Jul 08 11:26:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d400d4ca-2141-4774-99fb-5120c78986a4 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-639bc391-1988-4d98-8b4f-9ca37aa3c27a-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:33 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" returned: 0 in 1.314s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:33 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65 Jul 08 11:26:33 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:33 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 1073741824" returned: 0 in 1.239s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:33 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:26:33 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:34 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" returned: 0 in 0.818s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-90c934cc-8d44-4c1c-a938-5c4ad47e6a65" released by "delete_volume" :: held 2.251s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Created reservations ['d9bda1a8-b1ff-408f-9651-94e7b035b52a', 'f07fb2c1-29f9-4a92-8438-78fa58934715', '6829224e-ce95-4a32-ab03-bfa430d31a8a', 'e351b2ae-cc1e-4ba4-bf32-63fbb74b32ec'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:34 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:34 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:34 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.859s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be29fb2-d6a4-48c3-b843-d542b67c188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f4773f-4e65-428c-946a-81e3a509d165', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b16e03-2de5-4315-8309-fc145ef88c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Volume volume-11f4773f-4e65-428c-946a-81e3a509d165 (11f4773f-4e65-428c-946a-81e3a509d165): created successfully Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b16e03-2de5-4315-8309-fc145ef88c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Flow 'volume_create_manager' (5ce2ac0e-e08f-4bea-a1c2-206609ba4566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-cd460dad-2dc9-419a-9950-f74e411d3fb8 tempest-GroupsV314Test-147365702 None] Created volume successfully. Jul 08 11:26:35 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.956s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Deleted volume successfully. Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-800b1a6b-703e-4b54-9617-85caf7bf95bc tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-90c934cc-8d44-4c1c-a938-5c4ad47e6a65-delete_volume" released by "delete_volume" :: held 3.638s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-be43872c-ae96-4885-b5ee-01a56588d111-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-be43872c-ae96-4885-b5ee-01a56588d111-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "cinder-quobyte-be43872c-ae96-4885-b5ee-01a56588d111" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-be43872c-ae96-4885-b5ee-01a56588d111" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8d9ff-b00d-47b8-ad3f-1d83f1090a26]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:35 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 Jul 08 11:26:35 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:36 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Cloning volume 11f4773f-4e65-428c-946a-81e3a509d165 to volume 25d6421a-1a79-48ff-ac7b-207f98a70fc4 Jul 08 11:26:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Creating offline snapshot 4ed28623-980a-4714-b2ae-74f5a08fd15c of volume 11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:26:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ccd152-2b5c-4eb2-9a81-664d006e5f1e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:37 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:26:37 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:37 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111" returned: 0 in 1.752s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:37 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111 Jul 08 11:26:37 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:38 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-be43872c-ae96-4885-b5ee-01a56588d111" returned: 0 in 1.033s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:38 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 1.594s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-quobyte-be43872c-ae96-4885-b5ee-01a56588d111" released by "delete_volume" :: held 2.934s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:38 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c 1G Jul 08 11:26:38 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Created reservations ['b3367dda-1c28-428d-831e-4597c607c46b', '3783d6e9-89e1-4202-84b0-307a12edb282', '6a2bed09-0099-43a5-92d6-8b5e4931a194', '5d47acf9-4044-4152-b653-b905ee8c3b79'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:38 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:38 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:40 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.263s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Deleted volume successfully. Jul 08 11:26:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-47a076a3-138c-40db-9c17-73c4458a4230 tempest-VolumesListTestJSON-1066803268 None] Lock "cinder-be43872c-ae96-4885-b5ee-01a56588d111-delete_volume" released by "delete_volume" :: held 4.661s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:40 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c 1G" returned: 0 in 1.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f4773f-4e65-428c-946a-81e3a509d165 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:40 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f4773f-4e65-428c-946a-81e3a509d165 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:40 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:41 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11f4773f-4e65-428c-946a-81e3a509d165 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:41 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:26:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:41 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:41 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:42 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 1.113s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:42 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info Jul 08 11:26:42 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:43 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info" returned: 0 in 1.221s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:43 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:26:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:43 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info Jul 08 11:26:43 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:44 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.info" returned: 0 in 1.183s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Acquiring lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] snapshot: 4ed28623-980a-4714-b2ae-74f5a08fd15c, volume: 25d6421a-1a79-48ff-ac7b-207f98a70fc4, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f794f-2451-4132-b0ba-de054f339957]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:45 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:45 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Flow 'volume_create_manager' (8073b67d-889a-46ed-aa89-5164a60decc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f412d4-3103-4df8-bfce-8a64ff9156cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f412d4-3103-4df8-bfce-8a64ff9156cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-947952831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c352b4b8-e327-4660-8dd7-f0448c3e77e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9daaa9350de482090d9489f5bd8ae7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:45Z,use_quota=True,user_id='6b826530f49c4c1bbb269bca094bdb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9349d07-2305-4ecd-af95-fe5ae6d9316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9349d07-2305-4ecd-af95-fe5ae6d9316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5bea4e-0795-4be2-88ae-5f68c945bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5bea4e-0795-4be2-88ae-5f68c945bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c352b4b8-e327-4660-8dd7-f0448c3e77e3', 'volume_name': 'volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40228ac-b972-4e27-8fce-bc6181616390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40228ac-b972-4e27-8fce-bc6181616390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45f6f2a-84c3-4e14-8f96-a3cc58fa0a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:26:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Volume c352b4b8-e327-4660-8dd7-f0448c3e77e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3', 'volume_size': 1} Jul 08 11:26:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:46 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 1.426s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f4773f-4e65-428c-946a-81e3a509d165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac743a-137f-4e63-83ec-89cc0dc8adcc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:46 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:26:46 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:47 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:47 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:26:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:47 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 Jul 08 11:26:47 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:52 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:26:52 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:53 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:26:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:26:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:26:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:26:54 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4" returned: 0 in 6.967s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba194aa-7585-4c07-a2ce-448e852609aa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:54 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:26:54 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:55 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=148,cinder:INSERT=51,cinder:UPDATE=178,cinder:DELETE=14 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:26:55 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=54,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=17 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:26:55 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.995s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:55 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:26:55 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Converted 1024.00 MB image at 146.94 MB/s Jul 08 11:26:55 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 11:26:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:55 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 Jul 08 11:26:55 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:56 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4" returned: 0 in 0.700s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" released by "_copy_volume_from_snapshot" :: held 11.182s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Acquiring lock "cinder-quobyte-4ed28623-980a-4714-b2ae-74f5a08fd15c" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-4ed28623-980a-4714-b2ae-74f5a08fd15c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Deleting offline snapshot 4ed28623-980a-4714-b2ae-74f5a08fd15c of volume 11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] snapshot_file for this snap is: volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e0974-e5ca-4751-ab51-f13c06158194]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:56 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:56 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:57 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11f4773f-4e65-428c-946a-81e3a509d165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[628aaab2-049c-45bf-9a5d-8d789baa9242]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:57 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:26:57 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:57 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.765s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:57 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:57 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:58 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 0.800s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:58 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c Jul 08 11:26:58 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:59 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165.4ed28623-980a-4714-b2ae-74f5a08fd15c" returned: 0 in 0.660s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-4ed28623-980a-4714-b2ae-74f5a08fd15c" released by "_delete_snapshot" :: held 3.143s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.591s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.926s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-947952831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c352b4b8-e327-4660-8dd7-f0448c3e77e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9daaa9350de482090d9489f5bd8ae7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:26:45Z,use_quota=True,user_id='6b826530f49c4c1bbb269bca094bdb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Creating volume c352b4b8-e327-4660-8dd7-f0448c3e77e3 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:26:59 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:26:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:26:59 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 1073741824 Jul 08 11:26:59 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:26:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f35fe3ef-36df-4ef4-a3fb-967283bb44cb tempest-GroupsV314Test-147365702 None] Create group from source-group-8ebdd243-b4b0-4ad5-b55d-fb6dcd85b000 completed successfully. Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Acquiring lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183ee45-657c-4e54-b280-ae5c573fdc1b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:00 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 Jul 08 11:27:00 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:00 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 1073741824" returned: 0 in 1.233s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:00 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 Jul 08 11:27:00 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:01 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4" returned: 0 in 1.001s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:01 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4 Jul 08 11:27:01 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:01 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3" returned: 0 in 0.824s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45f6f2a-84c3-4e14-8f96-a3cc58fa0a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064704c5-8d42-4bf5-aed3-0ce36b48d327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:01 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Volume volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 (c352b4b8-e327-4660-8dd7-f0448c3e77e3): created successfully Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064704c5-8d42-4bf5-aed3-0ce36b48d327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:01 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Flow 'volume_create_manager' (8073b67d-889a-46ed-aa89-5164a60decc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:01 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a9d2b682-a806-47b3-bcf0-7bcda1a93628 tempest-VolumesNegativeTest-165940279 None] Created volume successfully. Jul 08 11:27:02 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-25d6421a-1a79-48ff-ac7b-207f98a70fc4" returned: 0 in 0.828s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-25d6421a-1a79-48ff-ac7b-207f98a70fc4" released by "delete_volume" :: held 1.896s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Created reservations ['2e41c85c-c5b4-4264-80b5-7dd346028074'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:02 devstack cinder-volume[86852]: WARNING cinder.quota [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-929886257 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-929886257, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:02 devstack cinder-volume[86852]: WARNING cinder.quota [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-929886257 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-929886257, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Created reservations ['64e2a886-663b-4ba3-9ae8-2ba21268e329', '4994d2e4-3197-41d4-ab6e-da8782189b00', 'edc0ddae-3748-45bd-ae1f-a0c0201a9b49', 'd8a41479-5a54-4960-92ed-b22439c3e2e0'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:02 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:02 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Acquiring lock "cinder-quobyte-11f4773f-4e65-428c-946a-81e3a509d165" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-11f4773f-4e65-428c-946a-81e3a509d165" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a308609-6e84-44c9-90b4-6efae8c2c50d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:03 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:27:03 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:03 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.075s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:03 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5d71d9ce-4a10-4af5-955a-951b02ba1a03 tempest-GroupsV314Test-147365702 None] Delete group completed successfully. Jul 08 11:27:04 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.847s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:04 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165 Jul 08 11:27:04 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:04 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-11f4773f-4e65-428c-946a-81e3a509d165" returned: 0 in 0.685s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Lock "cinder-quobyte-11f4773f-4e65-428c-946a-81e3a509d165" released by "delete_volume" :: held 1.626s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Created reservations ['be8b349a-7c68-4b62-a8de-dbdff64add88'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Created reservations ['8ab8d5af-8bc8-4ff5-b626-7a762a5eecee', '36a44973-96a7-4e17-b956-26d49d281757', '91628d81-5d1f-4d42-86b0-ea0ddeabbe3e', 'b7da77ee-a7a5-49d0-b006-b5fb031ed24a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:05 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:05 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:05 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.732s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:05 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-569be9e8-3b3b-4a72-bfed-b3b5fca6ad19 tempest-GroupsV314Test-147365702 None] Delete group completed successfully. Jul 08 11:27:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a853ab5-7d87-4446-8864-9c6a53e1c1a9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:10 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d Jul 08 11:27:10 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:11 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d" returned: 0 in 0.995s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.022s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-96bbf762-0c9b-4456-9aef-226e95b9b39d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61fa1d82-60d2-496f-9e7a-11aafe7c8b57', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:27:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-3f52245f-3910-497a-aae0-a7def961795f req-dfe776fc-d84e-45b4-9c54-47da17705117 tempest-TestInstancesWithCinderVolumes-1039527798 None] attachment_update completed successfully. Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Flow 'volume_create_manager' (acf013dd-e3e0-4dfb-93ed-50ed900ff64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f942b-38e5-4c29-a959-7e0f215fc19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f942b-38e5-4c29-a959-7e0f215fc19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1379799188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b12dc7-cf63-450c-a001-3463024438e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fbd9450ca461aa9a0d117af346f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:14Z,use_quota=True,user_id='9dd28efbfbc44b768a467d5b9c79a1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d7b173-4d5b-417d-be6e-a0c59560331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d7b173-4d5b-417d-be6e-a0c59560331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2457284f-927c-4c43-b608-bd22db517a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2457284f-927c-4c43-b608-bd22db517a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b12dc7-cf63-450c-a001-3463024438e7', 'volume_name': 'volume-f9b12dc7-cf63-450c-a001-3463024438e7', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d161466d-c587-4e52-9d35-556f2594f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d161466d-c587-4e52-9d35-556f2594f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70124559-cd1f-48ed-9221-a53aa2d4bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:13 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Volume f9b12dc7-cf63-450c-a001-3463024438e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b12dc7-cf63-450c-a001-3463024438e7', 'volume_size': 1} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1379799188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b12dc7-cf63-450c-a001-3463024438e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fbd9450ca461aa9a0d117af346f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:14Z,use_quota=True,user_id='9dd28efbfbc44b768a467d5b9c79a1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Creating volume f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:27:13 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:27:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:13 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 1073741824 Jul 08 11:27:13 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:14 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 1073741824" returned: 0 in 0.959s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:14 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:14 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:15 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 0.720s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70124559-cd1f-48ed-9221-a53aa2d4bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b12dc7-cf63-450c-a001-3463024438e7', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2904ecc-3352-4731-a0bd-5468ad573fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Volume volume-f9b12dc7-cf63-450c-a001-3463024438e7 (f9b12dc7-cf63-450c-a001-3463024438e7): created successfully Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2904ecc-3352-4731-a0bd-5468ad573fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Flow 'volume_create_manager' (acf013dd-e3e0-4dfb-93ed-50ed900ff64b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9d6ecc99-5147-439b-8203-c26f6d5fe180 tempest-SnapshotDependencyTests-503077276 None] Created volume successfully. Jul 08 11:27:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Creating offline snapshot 9dd6b862-4211-44f2-86b7-b2fee8858805 of volume f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:27:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd877c-54df-4af6-ad9a-c4975529d04c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:16 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:16 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:17 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 1.069s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:17 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 1G Jul 08 11:27:17 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:18 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 1G" returned: 0 in 1.051s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b12dc7-cf63-450c-a001-3463024438e7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:18 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b12dc7-cf63-450c-a001-3463024438e7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:18 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:19 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b12dc7-cf63-450c-a001-3463024438e7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 1.021s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:19 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 is being set with open permissions: ugo+rw Jul 08 11:27:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:19 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:19 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:20 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 0.881s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:20 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info Jul 08 11:27:20 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:21 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info" returned: 0 in 1.009s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:21 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info is being set with open permissions: ugo+rw Jul 08 11:27:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:21 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info Jul 08 11:27:21 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:22 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.info" returned: 0 in 0.916s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.111s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.308s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1946f5-ee27-4881-a94a-49a62edee5f9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fba729e1-bb53-495e-8210-8b5715941afb tempest-SnapshotDependencyTests-503077276 None] Create snapshot completed successfully Jul 08 11:27:22 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f Jul 08 11:27:22 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:23 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f" returned: 0 in 1.024s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.075s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Flow 'volume_create_manager' (6aa2b962-847c-4d6e-9a4e-9f2fe284644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b98f9dd-71dc-4e8f-9ef6-092c37dcb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-e6e84d33-5c82-4163-bd17-e5889144b89f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55e5b384-b8a8-4f8f-a0ca-ea402925757c', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b98f9dd-71dc-4e8f-9ef6-092c37dcb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82dd14a-71ac-424f-a076-6f8d74b4fe27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46fbd9450ca461aa9a0d117af346f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dd6b862-4211-44f2-86b7-b2fee8858805,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:23Z,use_quota=True,user_id='9dd28efbfbc44b768a467d5b9c79a1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148660cc-26ae-4277-89f6-fbfee0c28c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148660cc-26ae-4277-89f6-fbfee0c28c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed1593a-ba37-4443-af87-da3b1cc69871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed1593a-ba37-4443-af87-da3b1cc69871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd82dd14a-71ac-424f-a076-6f8d74b4fe27', 'volume_name': 'volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27', 'volume_size': 1, 'snapshot_id': '9dd6b862-4211-44f2-86b7-b2fee8858805'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bdde73-2831-46d4-8f28-d7619fc83b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bdde73-2831-46d4-8f28-d7619fc83b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330033ca-caba-4826-9e34-3a700f0104d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:23 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Volume d82dd14a-71ac-424f-a076-6f8d74b4fe27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27', 'volume_size': 1, 'snapshot_id': '9dd6b862-4211-44f2-86b7-b2fee8858805'} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805-d82dd14a-71ac-424f-a076-6f8d74b4fe27" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805-d82dd14a-71ac-424f-a076-6f8d74b4fe27" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Creating volume d82dd14a-71ac-424f-a076-6f8d74b4fe27 from snapshot 9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] snapshot: 9dd6b862-4211-44f2-86b7-b2fee8858805, volume: d82dd14a-71ac-424f-a076-6f8d74b4fe27, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:23 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-6825d5a9-e9ee-4f3c-8fa9-b469c7584aa8 req-406901c7-33c5-42ab-a2ef-5e467dd2d59b tempest-TestInstancesWithCinderVolumes-1039527798 None] attachment_update completed successfully. Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7930bbce-8dd7-43e8-ae5c-d1cfe82b1d0f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:23 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:23 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Flow 'volume_create_manager' (f15f1c18-89be-460f-944d-d5706b602e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caca9918-8052-4a5a-ae97-c736b52e3c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caca9918-8052-4a5a-ae97-c736b52e3c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-273948044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef71bf9-2191-4541-8980-8e1a50ceaf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a473532bf4fd4813561c627056e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:24Z,use_quota=True,user_id='2d8149c943b64037b20c2debe61bd8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a853500-ad79-4a13-b362-846ea9da1b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a853500-ad79-4a13-b362-846ea9da1b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e66f71-f5ed-460b-9949-077005892b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e66f71-f5ed-460b-9949-077005892b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef71bf9-2191-4541-8980-8e1a50ceaf1d', 'volume_name': 'volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d10561d-2ca2-452c-b42c-994694851df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d10561d-2ca2-452c-b42c-994694851df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc637a0-4057-484f-9e3d-b9cee21bf62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:24 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Volume aef71bf9-2191-4541-8980-8e1a50ceaf1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d', 'volume_size': 1} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:24 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 0.978s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b12dc7-cf63-450c-a001-3463024438e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf50fcc-0b59-4ea1-8b56-c367ad67ad56]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:24 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:24 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:25 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 0.913s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:25 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:27:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:25 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 Jul 08 11:27:25 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:30 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27" returned: 0 in 5.380s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191a694-63a7-42bc-b19b-8f43de08e387]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:31 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:31 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:31 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:31 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:27:31 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Converted 1024.00 MB image at 190.27 MB/s Jul 08 11:27:31 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 is being set with open permissions: ugo+rw Jul 08 11:27:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:31 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 Jul 08 11:27:31 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:32 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27" returned: 0 in 0.688s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" released by "_copy_volume_from_snapshot" :: held 9.087s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805-d82dd14a-71ac-424f-a076-6f8d74b4fe27" released by "_create_volume_from_snapshot" :: held 9.135s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.156s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.426s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-273948044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef71bf9-2191-4541-8980-8e1a50ceaf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a473532bf4fd4813561c627056e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:24Z,use_quota=True,user_id='2d8149c943b64037b20c2debe61bd8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Creating volume aef71bf9-2191-4541-8980-8e1a50ceaf1d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:27:32 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:32 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d 1073741824 Jul 08 11:27:32 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330033ca-caba-4826-9e34-3a700f0104d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27', 'volume_size': 1, 'snapshot_id': '9dd6b862-4211-44f2-86b7-b2fee8858805'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e2233a-9570-4631-b9ce-b749de5ef463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:32 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Volume volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 (d82dd14a-71ac-424f-a076-6f8d74b4fe27): created successfully Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e2233a-9570-4631-b9ce-b749de5ef463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Flow 'volume_create_manager' (6aa2b962-847c-4d6e-9a4e-9f2fe284644b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5af25182-c24f-4a79-9b6b-3a5a3a030123 tempest-SnapshotDependencyTests-503077276 None] Created volume successfully. Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-9dd6b862-4211-44f2-86b7-b2fee8858805-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-9dd6b862-4211-44f2-86b7-b2fee8858805-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Deleting offline snapshot 9dd6b862-4211-44f2-86b7-b2fee8858805 of volume f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] snapshot_file for this snap is: volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a2955f-7cf9-4c29-bc55-d7acf91d3659]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:33 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:33 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:33 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d 1073741824" returned: 0 in 1.009s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:33 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d Jul 08 11:27:33 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:34 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc637a0-4057-484f-9e3d-b9cee21bf62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:34 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5255619-d722-4308-b0aa-aa7f4552ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 0.910s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b12dc7-cf63-450c-a001-3463024438e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:27:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Volume volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d (aef71bf9-2191-4541-8980-8e1a50ceaf1d): created successfully Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5255619-d722-4308-b0aa-aa7f4552ce84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Flow 'volume_create_manager' (f15f1c18-89be-460f-944d-d5706b602e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2db982-faf7-4a34-b058-be803e8d0479]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0fd55af0-952c-48b6-a95f-dfc9b6fb297c tempest-VolumeQuotasNegativeTestJSON-801650547 None] Created volume successfully. Jul 08 11:27:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-035e4eb0-1f0d-49b7-99fe-90c5ce28e1a4 req-15c75709-fd29-4612-b3cb-ddf79b4eac5d tempest-TestInstancesWithCinderVolumes-1039527798 None] Terminate volume connection completed successfully. Jul 08 11:27:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-035e4eb0-1f0d-49b7-99fe-90c5ce28e1a4 req-15c75709-fd29-4612-b3cb-ddf79b4eac5d tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleting attachment 61fa1d82-60d2-496f-9e7a-11aafe7c8b57. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:27:34 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:34 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:35 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:35 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:35 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:36 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 0.909s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:36 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805 Jul 08 11:27:36 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Acquiring lock "cinder-aef71bf9-2191-4541-8980-8e1a50ceaf1d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "cinder-aef71bf9-2191-4541-8980-8e1a50ceaf1d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Acquiring lock "cinder-quobyte-aef71bf9-2191-4541-8980-8e1a50ceaf1d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-96bbf762-0c9b-4456-9aef-226e95b9b39d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "cinder-quobyte-aef71bf9-2191-4541-8980-8e1a50ceaf1d" acquired by "delete_volume" :: waited 0.037s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-96bbf762-0c9b-4456-9aef-226e95b9b39d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[90babc0a-9e58-4f75-a6ed-f786c309c58a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-quobyte-96bbf762-0c9b-4456-9aef-226e95b9b39d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-96bbf762-0c9b-4456-9aef-226e95b9b39d" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616e2a2-b343-4036-86f8-f3db8f5d4cac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:36 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d Jul 08 11:27:36 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:36 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d Jul 08 11:27:36 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:37 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7.9dd6b862-4211-44f2-86b7-b2fee8858805" returned: 0 in 0.927s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Acquiring lock "cinder-c352b4b8-e327-4660-8dd7-f0448c3e77e3-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-9dd6b862-4211-44f2-86b7-b2fee8858805" released by "_delete_snapshot" :: held 3.761s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" released by "delete_snapshot" :: held 3.798s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "cinder-c352b4b8-e327-4660-8dd7-f0448c3e77e3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Acquiring lock "cinder-quobyte-c352b4b8-e327-4660-8dd7-f0448c3e77e3" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "cinder-quobyte-c352b4b8-e327-4660-8dd7-f0448c3e77e3" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Created reservations ['11ddc161-fe0a-46d1-85eb-9030d6a32314', '8ff64b7a-72ae-42af-b31b-ce12fa1015d8', '689c6f6f-01f8-4aa5-93d8-f0d819fbbfbf', 'fd01780e-1e9f-404f-8880-e8d8777ece57'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b74b0e-5c33-491e-b740-022749b3a57a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Delete snapshot completed successfully. Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0a515f13-3374-48bb-8c94-0f6408e66ba1 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-9dd6b862-4211-44f2-86b7-b2fee8858805-delete_snapshot" released by "delete_snapshot" :: held 4.128s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:37 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 Jul 08 11:27:37 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:37 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d" returned: 0 in 1.093s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:37 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d Jul 08 11:27:37 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-f9b12dc7-cf63-450c-a001-3463024438e7-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-f9b12dc7-cf63-450c-a001-3463024438e7-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:38 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d" returned: 0 in 1.332s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf551a-519f-42a9-b215-f54c968f9526]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:38 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d Jul 08 11:27:38 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:38 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:38 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:38 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-aef71bf9-2191-4541-8980-8e1a50ceaf1d" returned: 0 in 0.907s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "cinder-quobyte-aef71bf9-2191-4541-8980-8e1a50ceaf1d" released by "delete_volume" :: held 2.067s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:38 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3" returned: 0 in 1.199s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Created reservations ['1da8f70d-7767-40ea-9c59-0b426384c653', '9c23fa72-948f-4154-9b0a-33a9a30b3de8', '083ddc24-a0f5-4226-941b-43fa82871d36', '32beabdb-f01a-4e34-b207-88e0d9e47d95'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:38 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3 Jul 08 11:27:38 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:38 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:38 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:39 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-96bbf762-0c9b-4456-9aef-226e95b9b39d" returned: 0 in 1.015s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:39 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 1.013s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-96bbf762-0c9b-4456-9aef-226e95b9b39d" released by "delete_volume" :: held 2.425s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:39 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7 Jul 08 11:27:39 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:39 devstack cinder-volume[86852]: WARNING cinder.quota [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813691366-963366608 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813691366-963366608, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:39 devstack cinder-volume[86852]: WARNING cinder.quota [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813691366-963366608 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1813691366-963366608, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Created reservations ['877b2d86-c0a8-4a8a-93fa-9217ef72ee85', 'ca21f4c9-8cac-44fd-98a1-68a7a3083450', '12a1acc1-6068-431b-b788-5dff10f1045c', 'd6c7b639-54ba-4fb4-9234-55fe2c9a3268'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:39 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:39 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:39 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.790s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:39 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Deleted volume successfully. Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0a2384f-56ca-4ea9-80ca-364790ce0e89 tempest-VolumeQuotasNegativeTestJSON-801650547 None] Lock "cinder-aef71bf9-2191-4541-8980-8e1a50ceaf1d-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:39 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c352b4b8-e327-4660-8dd7-f0448c3e77e3" returned: 0 in 1.013s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "cinder-quobyte-c352b4b8-e327-4660-8dd7-f0448c3e77e3" released by "delete_volume" :: held 2.272s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Created reservations ['5334b87e-6bac-4ba3-baec-3c1cb6aaedaf', 'd4e555b1-41ec-4367-96d2-3e44d5cc548a', '75219141-420c-4959-ad86-204f721bc1ed', '2bf2734f-587d-4187-b5e9-4d26c07fc617'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:39 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f9b12dc7-cf63-450c-a001-3463024438e7" returned: 0 in 0.832s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:39 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:39 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-f9b12dc7-cf63-450c-a001-3463024438e7" released by "delete_volume" :: held 1.921s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Created reservations ['6d2522c6-94d4-4f59-a857-1ec522392791', '1427ecbe-f6d3-4d89-8c11-a77df69e229d', '03d62e86-ab1c-40f0-a29c-c8a32651b710', '01c9f69b-9060-44ec-81c0-d8bed0369d4f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:40 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:40 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-d82dd14a-71ac-424f-a076-6f8d74b4fe27-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:40 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.019s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleted volume successfully. Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-d82dd14a-71ac-424f-a076-6f8d74b4fe27-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-596b861d-070f-4c23-b402-8a52da865620 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-96bbf762-0c9b-4456-9aef-226e95b9b39d-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[080726e9-b020-4f51-b62f-0384f0f593e6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:40 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 Jul 08 11:27:40 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:40 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.029s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Deleted volume successfully. Jul 08 11:27:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-26cfb97b-1b85-48b5-9ffa-561156a91c98 tempest-VolumesNegativeTest-165940279 None] Lock "cinder-c352b4b8-e327-4660-8dd7-f0448c3e77e3-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:41 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.950s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:41 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Deleted volume successfully. Jul 08 11:27:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1ce14064-e858-4a6e-82d1-fb26e2279f00 tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-f9b12dc7-cf63-450c-a001-3463024438e7-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:41 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27" returned: 0 in 1.036s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:41 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27 Jul 08 11:27:41 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-8f5f2ce3-6ad7-4c7d-8311-4e0bbd6fa164 req-b13ffb59-c280-4181-9cd1-2799a01f0920 tempest-TestInstancesWithCinderVolumes-1039527798 None] Terminate volume connection completed successfully. Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-8f5f2ce3-6ad7-4c7d-8311-4e0bbd6fa164 req-b13ffb59-c280-4181-9cd1-2799a01f0920 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleting attachment 55e5b384-b8a8-4f8f-a0ca-ea402925757c. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:27:42 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d82dd14a-71ac-424f-a076-6f8d74b4fe27" returned: 0 in 0.830s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-quobyte-d82dd14a-71ac-424f-a076-6f8d74b4fe27" released by "delete_volume" :: held 1.933s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Created reservations ['38d91819-2060-49c6-86ff-6a1fe8b19c06', '49f31b79-f54a-48a8-b820-ea85fea3c538', 'd2fa59b7-b6e2-44a5-92df-c2c01efa6c1d', '15e1a516-7cb3-4275-8662-6d32dafd2e45'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:42 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:42 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:43 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.761s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:43 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:43 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Deleted volume successfully. Jul 08 11:27:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9b99c1ad-75d6-4d0a-906f-62e2ffe9a8bb tempest-SnapshotDependencyTests-503077276 None] Lock "cinder-d82dd14a-71ac-424f-a076-6f8d74b4fe27-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-e6e84d33-5c82-4163-bd17-e5889144b89f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-e6e84d33-5c82-4163-bd17-e5889144b89f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-quobyte-e6e84d33-5c82-4163-bd17-e5889144b89f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-e6e84d33-5c82-4163-bd17-e5889144b89f" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b9e80-2bdf-4a7b-9fde-cd64536e51a2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:44 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f Jul 08 11:27:44 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Flow 'volume_create_manager' (45ab6df8-4acf-44de-bfa1-92061a82ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4074f3f3-03f8-4e99-b4cb-1492e975091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4074f3f3-03f8-4e99-b4cb-1492e975091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-923945385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a09c4d-6d18-4608-9949-8c928eaadaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673db3ff770d444599075ed89c1524b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:44Z,use_quota=True,user_id='e60de1793def40068febd0748e2eaa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21296499-0094-4a71-a257-9e92d77f5696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21296499-0094-4a71-a257-9e92d77f5696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1291a167-ff51-40f1-bd2b-533e8e91a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1291a167-ff51-40f1-bd2b-533e8e91a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a09c4d-6d18-4608-9949-8c928eaadaf7', 'volume_name': 'volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7', 'volume_size': 2}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1388e-1b14-4b61-907a-76302b509204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1388e-1b14-4b61-907a-76302b509204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06c1fd3-1543-4c69-b7fe-4b600c5279bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Volume d9a09c4d-6d18-4608-9949-8c928eaadaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7', 'volume_size': 2} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-923945385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a09c4d-6d18-4608-9949-8c928eaadaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673db3ff770d444599075ed89c1524b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:44Z,use_quota=True,user_id='e60de1793def40068febd0748e2eaa16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Creating volume d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:27:44 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:27:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 2147483648 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:44 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 2147483648 Jul 08 11:27:44 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:45 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f" returned: 0 in 0.941s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:45 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f Jul 08 11:27:45 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:46 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 2147483648" returned: 0 in 1.447s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:46 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 Jul 08 11:27:46 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:46 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-e6e84d33-5c82-4163-bd17-e5889144b89f" returned: 0 in 1.009s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-e6e84d33-5c82-4163-bd17-e5889144b89f" released by "delete_volume" :: held 2.026s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:46 devstack cinder-volume[86852]: WARNING cinder.quota [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-134742731-1522581335 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-134742731-1522581335, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:46 devstack cinder-volume[86852]: WARNING cinder.quota [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-134742731-1522581335 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-134742731-1522581335, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Created reservations ['4b84db95-0fb7-4044-8079-50d4fc71f730', '4ce9b236-7bb5-4071-aada-115170f5827d', '4e992846-65b2-4c16-8d2c-19e9d2968bb2', 'a4543211-9232-41bf-8695-7b416f900473'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:46 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:46 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:47 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.800s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleted volume successfully. Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a54dd70c-d056-400e-b333-4a9b62deebc9 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-e6e84d33-5c82-4163-bd17-e5889144b89f-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:47 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7" returned: 0 in 1.187s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] <== create_volume: return (2723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06c1fd3-1543-4c69-b7fe-4b600c5279bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7', 'volume_size': 2}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de73c5-3995-4fe4-8ad0-9b144e5a574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Volume volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 (d9a09c4d-6d18-4608-9949-8c928eaadaf7): created successfully Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de73c5-3995-4fe4-8ad0-9b144e5a574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Flow 'volume_create_manager' (45ab6df8-4acf-44de-bfa1-92061a82ee07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-70be04e5-07b6-49a0-9fb7-4cc6f98e99a1 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Created volume successfully. Jul 08 11:27:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Creating offline snapshot e638d7b1-82ad-4eda-b4da-1bf02cd43780 of volume d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:27:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce571bf9-1092-4794-9603-c3b3c05eb6a2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:48 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 Jul 08 11:27:48 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Flow 'volume_create_manager' (da215c52-8d2f-4050-9e00-db20799dea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14222f1e-c7d0-42bb-9fdf-4e0d65f92e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14222f1e-c7d0-42bb-9fdf-4e0d65f92e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-798110358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88e01ed-b8f9-491a-8c2e-3feaf3dada34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b1aa772d9d49bb89985116646f21f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:49Z,use_quota=True,user_id='6fb23b77e0654cf0a8ce6fb3d9722586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d37ecaa-c14f-4d55-957e-7f420aeadf01),volume_type_id=1d37ecaa-c14f-4d55-957e-7f420aeadf01)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:49 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856982f9-cef8-41e2-8cbf-c0c4bc199bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856982f9-cef8-41e2-8cbf-c0c4bc199bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a731f-f365-4400-8acf-c1fbddc5021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8a731f-f365-4400-8acf-c1fbddc5021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88e01ed-b8f9-491a-8c2e-3feaf3dada34', 'volume_name': 'volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab19e37-8ff1-4cc6-8864-4cc65df1ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab19e37-8ff1-4cc6-8864-4cc65df1ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfc0ccd-300c-48b0-afcd-a99f7eb38100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:49 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Volume a88e01ed-b8f9-491a-8c2e-3feaf3dada34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34', 'volume_size': 1} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7" returned: 0 in 1.097s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 2G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:49 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 2G Jul 08 11:27:49 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:50 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 2G" returned: 0 in 1.174s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:50 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 Jul 08 11:27:50 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:51 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780" returned: 0 in 0.849s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:51 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 is being set with open permissions: ugo+rw Jul 08 11:27:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:51 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 Jul 08 11:27:51 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:51 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:52 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info Jul 08 11:27:52 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-80832446-c36e-4025-81a6-782bc68e4319 req-7b6d4d14-b965-43b0-83d4-43d64cb6119b tempest-TestInstancesWithCinderVolumes-1039527798 None] Terminate volume connection completed successfully. Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-80832446-c36e-4025-81a6-782bc68e4319 req-7b6d4d14-b965-43b0-83d4-43d64cb6119b tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleting attachment 2500d7fc-4dce-4871-baaa-befc0c391365. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:52 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:52 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:52 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info" returned: 0 in 0.785s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:52 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info is being set with open permissions: ugo+rw Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:52 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info Jul 08 11:27:52 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:52 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:27:53 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.info" returned: 0 in 0.742s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.459s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.313s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-798110358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88e01ed-b8f9-491a-8c2e-3feaf3dada34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b1aa772d9d49bb89985116646f21f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:27:49Z,use_quota=True,user_id='6fb23b77e0654cf0a8ce6fb3d9722586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d37ecaa-c14f-4d55-957e-7f420aeadf01),volume_type_id=1d37ecaa-c14f-4d55-957e-7f420aeadf01)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Creating volume a88e01ed-b8f9-491a-8c2e-3feaf3dada34 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:27:53 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:27:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:53 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 1073741824 Jul 08 11:27:53 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-10517305-8e28-4ca5-b828-304d0080de33 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Create snapshot completed successfully Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "cinder-e638d7b1-82ad-4eda-b4da-1bf02cd43780-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-e638d7b1-82ad-4eda-b4da-1bf02cd43780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "cinder-quobyte-e638d7b1-82ad-4eda-b4da-1bf02cd43780" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:54 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 1073741824" returned: 0 in 0.960s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-e638d7b1-82ad-4eda-b4da-1bf02cd43780" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Deleting offline snapshot e638d7b1-82ad-4eda-b4da-1bf02cd43780 of volume d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] snapshot_file for this snap is: volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82b19a-cb88-4ed6-882d-842113fb5f4d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:54 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 Jul 08 11:27:54 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:54 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 Jul 08 11:27:54 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:55 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" returned: 0 in 0.740s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfc0ccd-300c-48b0-afcd-a99f7eb38100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28a6fe-c7c8-42bc-89a0-d0815c9433ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:27:55 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Volume volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 (a88e01ed-b8f9-491a-8c2e-3feaf3dada34): created successfully Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28a6fe-c7c8-42bc-89a0-d0815c9433ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Flow 'volume_create_manager' (da215c52-8d2f-4050-9e00-db20799dea19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=100,cinder:SELECT=83,cinder:INSERT=25,cinder:DELETE=10 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:27:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fc3ab5a5-002a-4352-9643-afccdbc007a2 tempest-VolumeTypesAccessTest-657483881 None] Created volume successfully. Jul 08 11:27:55 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780" returned: 0 in 0.876s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c47ae8-87fa-4fc0-838a-8f6c0944177b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Acquiring lock "cinder-a88e01ed-b8f9-491a-8c2e-3feaf3dada34-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:55 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 Jul 08 11:27:55 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "cinder-a88e01ed-b8f9-491a-8c2e-3feaf3dada34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=102,cinder:SELECT=89,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Acquiring lock "cinder-quobyte-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "cinder-quobyte-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6a5ab-725c-4421-aa50-05507cd74c71]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:55 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 Jul 08 11:27:55 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-fab98b71-d882-4cf9-9ae3-31032f775714-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-fab98b71-d882-4cf9-9ae3-31032f775714-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "cinder-quobyte-fab98b71-d882-4cf9-9ae3-31032f775714" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-fab98b71-d882-4cf9-9ae3-31032f775714" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3a94d-0d62-45a8-8636-811c27d3296e]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:56 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:27:56 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:56 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7" returned: 0 in 0.925s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:56 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 Jul 08 11:27:56 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:56 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" returned: 0 in 0.915s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:56 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34 Jul 08 11:27:56 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:56 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 0.890s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:57 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:27:57 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:57 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780" returned: 0 in 0.770s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:57 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780 Jul 08 11:27:57 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:57 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" returned: 0 in 0.660s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "cinder-quobyte-a88e01ed-b8f9-491a-8c2e-3feaf3dada34" released by "delete_volume" :: held 1.630s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:57 devstack cinder-volume[86852]: WARNING cinder.quota [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-146768595 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-146768595, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:57 devstack cinder-volume[86852]: WARNING cinder.quota [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-146768595 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-146768595, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Created reservations ['6b7cf035-7941-49fe-b574-76bd896b9456', '6ae0be1f-3ab8-4ec9-ad82-a53ddadbd9f4', '3a702ceb-fa66-49d9-9711-4b44384ead8e', '13bc8943-523c-4b52-bb67-9d13b5191465'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:57 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:57 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:57 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 1 in 0.774s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:57 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714 Jul 08 11:27:57 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:57 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7.e638d7b1-82ad-4eda-b4da-1bf02cd43780" returned: 0 in 0.714s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-e638d7b1-82ad-4eda-b4da-1bf02cd43780" released by "_delete_snapshot" :: held 3.424s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" released by "delete_snapshot" :: held 3.461s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Created reservations ['8047e6fb-4c7d-46e5-a504-efd476649bda', '481582b0-7a9d-4342-96c4-9e54e883583f', 'dc3dd36a-b417-4a5d-8321-416bdb3a5fde', '9671dd09-237f-4108-9013-1ebf5759da9d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Delete snapshot completed successfully. Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68efce93-e2f8-4879-99f8-67f657302adc tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-e638d7b1-82ad-4eda-b4da-1bf02cd43780-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:58 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.750s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Deleted volume successfully. Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d32991d0-4938-4063-9a23-18b8e752948a tempest-VolumeTypesAccessTest-657483881 None] Lock "cinder-a88e01ed-b8f9-491a-8c2e-3feaf3dada34-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:58 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-fab98b71-d882-4cf9-9ae3-31032f775714" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-quobyte-fab98b71-d882-4cf9-9ae3-31032f775714" released by "delete_volume" :: held 2.453s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:58 devstack cinder-volume[86852]: WARNING cinder.quota [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310748257-1917980874 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310748257-1917980874, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:58 devstack cinder-volume[86852]: WARNING cinder.quota [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310748257-1917980874 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1310748257-1917980874, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Created reservations ['2548c17a-4ab5-4026-ac43-18cc98e4cf54', '29eada09-00cd-465f-abfb-cffcbe172cf8', 'dc377c6f-a5ea-4657-b071-2e857f033a9b', '9626b6c4-2449-4e04-8ae2-c98eed362321'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:58 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:27:58 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "cinder-d9a09c4d-6d18-4608-9949-8c928eaadaf7-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-d9a09c4d-6d18-4608-9949-8c928eaadaf7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[787682d9-d129-4d38-bc13-d5c9ab022a63]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:27:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:59 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 Jul 08 11:27:59 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:27:59 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.726s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:59 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:27:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Deleted volume successfully. Jul 08 11:27:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1523fa36-d388-4cee-a0f8-f937c6357533 tempest-TestInstancesWithCinderVolumes-1039527798 None] Lock "cinder-fab98b71-d882-4cf9-9ae3-31032f775714-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:27:59 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 08 11:27:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7" returned: 0 in 0.883s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:27:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:27:59 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7 Jul 08 11:27:59 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:00 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d9a09c4d-6d18-4608-9949-8c928eaadaf7" returned: 0 in 0.726s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-quobyte-d9a09c4d-6d18-4608-9949-8c928eaadaf7" released by "delete_volume" :: held 1.692s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Created reservations ['fd42dda0-9b7c-4b61-99f1-7adb8edc63fc', '469ba2c7-eab8-4da6-a666-98d4f4cc1161', '446bf6f7-ff02-49a1-80e3-67c8fd5be2e2', '746990b0-8805-4c3d-9586-6931a702dc17'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:00 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:00 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:01 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.934s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:01 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:01 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Deleted volume successfully. Jul 08 11:28:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ccec7962-cf02-4182-893e-af2bea89fe51 tempest-VolumesSnapshotNegativeTestJSON-1910816950 None] Lock "cinder-d9a09c4d-6d18-4608-9949-8c928eaadaf7-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Flow 'volume_create_manager' (e20cdecc-d233-44e7-8ed5-dda0fe98e7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab94095-6025-412d-9e00-bf0b0b92f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab94095-6025-412d-9e00-bf0b0b92f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52c5890-e977-4e1a-9e2d-1497833e7cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe99e69c04c4400abc694b78dedd645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:09Z,use_quota=True,user_id='2f6062408d46493b9bd0912ca2acdf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(863acb4c-23c1-49b6-b21a-103de6e0be87),volume_type_id=863acb4c-23c1-49b6-b21a-103de6e0be87)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460b5cc3-1bf9-45b4-97f0-a973e5ef3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460b5cc3-1bf9-45b4-97f0-a973e5ef3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe478e79-65d3-4872-8bb2-3e357126764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:09 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe478e79-65d3-4872-8bb2-3e357126764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b52c5890-e977-4e1a-9e2d-1497833e7cda', 'volume_name': 'volume-b52c5890-e977-4e1a-9e2d-1497833e7cda', 'volume_size': 1, 'image_id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00110757847e12b48ec4f76f75ad0c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfe99e69c04c4400abc694b78dedd645', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1996d4e72e15e12dc6325d75ff01fe79cf5f10f31cd4f363c3670a3ad363716802c5c74117c7d0c017b9d494968c3b404347ef2e846b182ae9caafd81af72ef0', 'id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'created_at': datetime.datetime(2026, 7, 8, 9, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 28, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e562791b-b980-4136-ba7b-6085a235e76f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d415a4e1-f36e-4991-bf4a-8d7082c0be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d415a4e1-f36e-4991-bf4a-8d7082c0be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f173da1-5109-40b7-9815-5d0cbb79b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Volume b52c5890-e977-4e1a-9e2d-1497833e7cda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b52c5890-e977-4e1a-9e2d-1497833e7cda', 'volume_size': 1, 'image_id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00110757847e12b48ec4f76f75ad0c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfe99e69c04c4400abc694b78dedd645', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1996d4e72e15e12dc6325d75ff01fe79cf5f10f31cd4f363c3670a3ad363716802c5c74117c7d0c017b9d494968c3b404347ef2e846b182ae9caafd81af72ef0', 'id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'created_at': datetime.datetime(2026, 7, 8, 9, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 28, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e562791b-b980-4136-ba7b-6085a235e76f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Trying to clone b52c5890-e977-4e1a-9e2d-1497833e7cda from image e562791b-b980-4136-ba7b-6085a235e76f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:28:10 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156e6bd-71e4-422f-98eb-2a480c5c64b3]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:10 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:10 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:11 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:11 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:11 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Flow 'volume_create_manager' (ccbc8c34-1bf5-47cc-917a-6d39ffc59dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68865e17-435d-4a71-af31-eb5b1764a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68865e17-435d-4a71-af31-eb5b1764a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1165368052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b007f9-f4de-4105-805d-f2bea5a353a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b4b36a7880467da005f9e2c5fdba33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:12Z,use_quota=True,user_id='f65dbb05ce9b40b6b3f81d8d7615f60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477097bf-29ae-48e4-b0f3-d64751e83182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477097bf-29ae-48e4-b0f3-d64751e83182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320fb3d-4f75-44a0-904e-4c265d591f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:11 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:28:12 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Temporary image e562791b-b980-4136-ba7b-6085a235e76f is fetched for user 2f6062408d46493b9bd0912ca2acdf5b. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5ee41-28c2-4e37-9430-18d557c71a12]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5320fb3d-4f75-44a0-904e-4c265d591f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9b007f9-f4de-4105-805d-f2bea5a353a7', 'volume_name': 'volume-a9b007f9-f4de-4105-805d-f2bea5a353a7', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7342162c-c11d-4d30-a1d4-dd12d7e2c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7342162c-c11d-4d30-a1d4-dd12d7e2c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7ca5a1-ad73-407e-b267-6fc307ac3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:12 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Volume a9b007f9-f4de-4105-805d-f2bea5a353a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9b007f9-f4de-4105-805d-f2bea5a353a7', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Trying to clone a9b007f9-f4de-4105-805d-f2bea5a353a7 from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:28:12 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:12 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:28:12 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Image download 20.69 MB at 20.69 MB/s Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f04b9-7952-4e33-82d4-1c6e51aeabd8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:12 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD Jul 08 11:28:12 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:13 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:13 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:13 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:13 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 is fetched for user f65dbb05ce9b40b6b3f81d8d7615f60d. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[29540a25-bcc2-48f2-a629-3692ad55c49d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:13 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD Jul 08 11:28:13 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:13 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52c5890-e977-4e1a-9e2d-1497833e7cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe99e69c04c4400abc694b78dedd645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:09Z,use_quota=True,user_id='2f6062408d46493b9bd0912ca2acdf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(863acb4c-23c1-49b6-b21a-103de6e0be87),volume_type_id=863acb4c-23c1-49b6-b21a-103de6e0be87)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Creating volume b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:13 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:13 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1073741824 Jul 08 11:28:13 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:14 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:14 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1073741824" returned: 0 in 0.891s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:14 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:14 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:15 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 0 in 0.665s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.107s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1165368052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b007f9-f4de-4105-805d-f2bea5a353a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b4b36a7880467da005f9e2c5fdba33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:12Z,use_quota=True,user_id='f65dbb05ce9b40b6b3f81d8d7615f60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Creating volume a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:15 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:15 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1073741824 Jul 08 11:28:15 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Attempting download of e562791b-b980-4136-ba7b-6085a235e76f ((None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}])) to volume b52c5890-e977-4e1a-9e2d-1497833e7cda. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96bc0b6-ab35-4290-95c4-adfed97886cd]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:15 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be Jul 08 11:28:15 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:16 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be" returned: 0 in 0.878s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:16 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1073741824" returned: 0 in 1.007s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:16 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:16 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:16 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be Jul 08 11:28:16 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:17 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be" returned: 1 in 0.831s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e562791b-b980-4136-ba7b-6085a235e76f_cydep1be' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:17 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95887ec-e451-4a2c-bcc2-c4e21910828f]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 0 in 0.766s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Attempting download of 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume a9b007f9-f4de-4105-805d-f2bea5a353a7. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b878595-f714-46d5-af3a-9ce6c7bf308a]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:17 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:17 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:17 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj Jul 08 11:28:17 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:18 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:18 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD Jul 08 11:28:18 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:18 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj" returned: 0 in 0.887s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:18 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj Jul 08 11:28:18 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:18 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] e562791b-b980-4136-ba7b-6085a235e76f was raw, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:28:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:18 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:18 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:19 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj" returned: 1 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c13436c-39fd-4e1e-9478-9ae05ec64994_j6sv8rsj' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da142c7-ee52-422b-a280-6cfac2bd2084]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:19 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD Jul 08 11:28:19 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:19 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 0 in 0.860s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e562791b-b980-4136-ba7b-6085a235e76f_21lz6txxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:28:19 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:19 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1G Jul 08 11:28:19 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:19 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD" returned: 0 in 0.855s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] 9c13436c-39fd-4e1e-9478-9ae05ec64994 was qcow2, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:28:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:20 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:20 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:20 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda 1G" returned: 0 in 0.739s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0ce8f-02a6-4b53-af27-cd6da27bc0b5]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:20 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:20 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:21 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 0 in 0.997s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:21 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:21 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:22 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 1 in 0.941s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:22 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Downloaded image e562791b-b980-4136-ba7b-6085a235e76f ((None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}])) to volume b52c5890-e977-4e1a-9e2d-1497833e7cda successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Temporary image e562791b-b980-4136-ba7b-6085a235e76f for user 2f6062408d46493b9bd0912ca2acdf5b is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Marking volume b52c5890-e977-4e1a-9e2d-1497833e7cda as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 0 in 2.479s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c13436c-39fd-4e1e-9478-9ae05ec64994_70i0xjc3devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:28:22 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Converted 112.00 MB image at 45.16 MB/s Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Copying metadata from image e562791b-b980-4136-ba7b-6085a235e76f to b52c5890-e977-4e1a-9e2d-1497833e7cda. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Creating volume glance metadata for volume b52c5890-e977-4e1a-9e2d-1497833e7cda backed by image e562791b-b980-4136-ba7b-6085a235e76f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '00110757847e12b48ec4f76f75ad0c08', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:28:22 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1G Jul 08 11:28:22 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f173da1-5109-40b7-9815-5d0cbb79b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52c5890-e977-4e1a-9e2d-1497833e7cda', 'volume_size': 1, 'image_id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e562791b-b980-4136-ba7b-6085a235e76f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00110757847e12b48ec4f76f75ad0c08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfe99e69c04c4400abc694b78dedd645', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1996d4e72e15e12dc6325d75ff01fe79cf5f10f31cd4f363c3670a3ad363716802c5c74117c7d0c017b9d494968c3b404347ef2e846b182ae9caafd81af72ef0', 'id': 'e562791b-b980-4136-ba7b-6085a235e76f', 'created_at': datetime.datetime(2026, 7, 8, 9, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 28, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e562791b-b980-4136-ba7b-6085a235e76f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359c0d19-8364-4fc5-b775-dc62b43bf8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:22 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Volume volume-b52c5890-e977-4e1a-9e2d-1497833e7cda (b52c5890-e977-4e1a-9e2d-1497833e7cda): created successfully Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359c0d19-8364-4fc5-b775-dc62b43bf8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Flow 'volume_create_manager' (e20cdecc-d233-44e7-8ed5-dda0fe98e7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-49d94606-6814-4a0b-900f-5d2f6da52288 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Created volume successfully. Jul 08 11:28:23 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 1G" returned: 0 in 0.739s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d553bac-1dfe-4356-8582-2cbc2ca17d50]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:23 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:23 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Acquiring lock "cinder-b52c5890-e977-4e1a-9e2d-1497833e7cda-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "cinder-b52c5890-e977-4e1a-9e2d-1497833e7cda-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Acquiring lock "cinder-quobyte-b52c5890-e977-4e1a-9e2d-1497833e7cda" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "cinder-quobyte-b52c5890-e977-4e1a-9e2d-1497833e7cda" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739ec92-c98d-40c7-b4dd-2463f3ea5e4f]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:23 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:23 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:24 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 0 in 0.827s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:24 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:24 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:24 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 0 in 0.906s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:24 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:24 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:24 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 1 in 0.884s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Downloaded image 9c13436c-39fd-4e1e-9478-9ae05ec64994 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}])) to volume a9b007f9-f4de-4105-805d-f2bea5a353a7 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Temporary image 9c13436c-39fd-4e1e-9478-9ae05ec64994 for user f65dbb05ce9b40b6b3f81d8d7615f60d is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Marking volume a9b007f9-f4de-4105-805d-f2bea5a353a7 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Copying metadata from image 9c13436c-39fd-4e1e-9478-9ae05ec64994 to a9b007f9-f4de-4105-805d-f2bea5a353a7. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:28:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Creating volume glance metadata for volume a9b007f9-f4de-4105-805d-f2bea5a353a7 backed by image 9c13436c-39fd-4e1e-9478-9ae05ec64994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7ca5a1-ad73-407e-b267-6fc307ac3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b007f9-f4de-4105-805d-f2bea5a353a7', 'volume_size': 1, 'image_id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c13436c-39fd-4e1e-9478-9ae05ec64994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c535b45f643341cf9f263037420168dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9c13436c-39fd-4e1e-9478-9ae05ec64994', 'created_at': datetime.datetime(2026, 7, 8, 9, 5, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 5, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c13436c-39fd-4e1e-9478-9ae05ec64994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5298b144-1ddf-4a6b-866a-bcc868b97511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Volume volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 (a9b007f9-f4de-4105-805d-f2bea5a353a7): created successfully Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5298b144-1ddf-4a6b-866a-bcc868b97511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Flow 'volume_create_manager' (ccbc8c34-1bf5-47cc-917a-6d39ffc59dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3403c528-d530-4a8c-992b-40d70ff495f7 tempest-VolumesImageMetadata-1407698260 None] Created volume successfully. Jul 08 11:28:25 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 1 in 0.863s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:25 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda Jul 08 11:28:25 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Acquiring lock "cinder-a9b007f9-f4de-4105-805d-f2bea5a353a7-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "cinder-a9b007f9-f4de-4105-805d-f2bea5a353a7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Acquiring lock "cinder-quobyte-a9b007f9-f4de-4105-805d-f2bea5a353a7" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "cinder-quobyte-a9b007f9-f4de-4105-805d-f2bea5a353a7" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5be09f-a112-4735-a836-3cc7da5ed690]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:26 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b52c5890-e977-4e1a-9e2d-1497833e7cda" returned: 0 in 0.787s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "cinder-quobyte-b52c5890-e977-4e1a-9e2d-1497833e7cda" released by "delete_volume" :: held 2.628s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:26 devstack cinder-volume[86852]: WARNING cinder.quota [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:28:26 devstack cinder-volume[86852]: WARNING cinder.quota [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Created reservations ['92c98d92-4185-4cb0-a8e4-1f1121f2bf34', 'fd579331-cf8a-48d3-8737-dea2436dba61', 'cfb01ded-42ef-4b64-8944-e7a4d72f2c7f', 'c40428d2-33b2-4288-9f61-40f91cf1a32f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:26 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:26 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:26 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:26 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 0 in 0.900s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:27 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.810s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Deleted volume successfully. Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2dda70c6-fe2f-4015-8ec2-a88d8aa02e22 tempest-VolumeAndVolumeTypeFromImageTest-563780153 None] Lock "cinder-b52c5890-e977-4e1a-9e2d-1497833e7cda-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:27 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:27 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:27 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 1 in 0.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:28:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:28 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7 Jul 08 11:28:28 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:28 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a9b007f9-f4de-4105-805d-f2bea5a353a7" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "cinder-quobyte-a9b007f9-f4de-4105-805d-f2bea5a353a7" released by "delete_volume" :: held 2.586s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Created reservations ['a9ff9f6c-f875-4608-a9b3-0f9310a7d7e4', '3629971b-a125-4f95-83e6-bac4ddea19ef', '25036f12-e8be-40e0-917d-24061fcd94cd', '23da305b-27dc-40b5-92ee-e99e61748167'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:28 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:28 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:29 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.734s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:29 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Deleted volume successfully. Jul 08 11:28:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fd97a74c-f238-46d8-ace9-e2081cba8031 tempest-VolumesImageMetadata-1407698260 None] Lock "cinder-a9b007f9-f4de-4105-805d-f2bea5a353a7-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (aaefb8ac-6c2c-40c4-8589-f95d1f7eb869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537247dc-2dad-4116-bc69-162f8109ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537247dc-2dad-4116-bc69-162f8109ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216160216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9eed8d-b46b-43d9-9df7-d20d418bcd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:32Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59d52dc-3d3c-4817-a87e-52b1ec5123e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59d52dc-3d3c-4817-a87e-52b1ec5123e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac30bba-38db-4bba-8db0-6867f8e53573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac30bba-38db-4bba-8db0-6867f8e53573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9eed8d-b46b-43d9-9df7-d20d418bcd70', 'volume_name': 'volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3827c39-d8a9-4bc1-9044-68a74b2abff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3827c39-d8a9-4bc1-9044-68a74b2abff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72f6c0a-07ed-4ace-b566-78adb62b34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:32 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume 9c9eed8d-b46b-43d9-9df7-d20d418bcd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70', 'volume_size': 1} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216160216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9eed8d-b46b-43d9-9df7-d20d418bcd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:32Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume 9c9eed8d-b46b-43d9-9df7-d20d418bcd70 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:32 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:32 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 1073741824 Jul 08 11:28:32 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Flow 'volume_create_manager' (3eb548a1-7908-46c4-a166-04a60e6aaa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db44f057-7a25-4106-bd3a-c81bedd078d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db44f057-7a25-4106-bd3a-c81bedd078d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-756313551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae4b297-c085-4e3e-aa2a-faf76c9cc384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570c69cc59674552a62cba94cb2528ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:33Z,use_quota=True,user_id='09e1a5ed6d174582a2cfdf39cf823b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590e2b9-e716-474f-bf73-af581c6a07d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7590e2b9-e716-474f-bf73-af581c6a07d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2dea23-5cb8-4982-b859-1de5b0f9304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce2dea23-5cb8-4982-b859-1de5b0f9304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae4b297-c085-4e3e-aa2a-faf76c9cc384', 'volume_name': 'volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f086a6c6-c42e-4394-a10d-2e2c2c3a5ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f086a6c6-c42e-4394-a10d-2e2c2c3a5ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020d944a-fff5-4844-bdaa-3ffccf4b23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:33 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Volume cae4b297-c085-4e3e-aa2a-faf76c9cc384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384', 'volume_size': 1} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:33 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 1073741824" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:33 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 Jul 08 11:28:33 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:34 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-756313551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae4b297-c085-4e3e-aa2a-faf76c9cc384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570c69cc59674552a62cba94cb2528ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:33Z,use_quota=True,user_id='09e1a5ed6d174582a2cfdf39cf823b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Creating volume cae4b297-c085-4e3e-aa2a-faf76c9cc384 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:34 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72f6c0a-07ed-4ace-b566-78adb62b34fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5003530-ea9b-45bd-b1cf-7e88f437c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:34 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 1073741824 Jul 08 11:28:34 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:34 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 (9c9eed8d-b46b-43d9-9df7-d20d418bcd70): created successfully Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5003530-ea9b-45bd-b1cf-7e88f437c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (aaefb8ac-6c2c-40c4-8589-f95d1f7eb869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4b2e290e-f6a1-411d-a000-592ac335796b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (deda2908-681c-48ea-ac82-56f10b5c10e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0928f-be3e-4c07-ae7b-c132a3e00aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0928f-be3e-4c07-ae7b-c132a3e00aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927331822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8a67f4-2885-4747-9607-645268c47cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:35Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6622ee0e-d542-4b2f-b6de-544c8dc10970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6622ee0e-d542-4b2f-b6de-544c8dc10970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4619cdc2-8960-46e6-abdf-b5c82f4fa79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4619cdc2-8960-46e6-abdf-b5c82f4fa79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8a67f4-2885-4747-9607-645268c47cb8', 'volume_name': 'volume-0b8a67f4-2885-4747-9607-645268c47cb8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e9faf8-11ae-4ec3-b37e-81bdb5f17153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e9faf8-11ae-4ec3-b37e-81bdb5f17153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8077220-8319-418a-96bf-4b2827143162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume 0b8a67f4-2885-4747-9607-645268c47cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8a67f4-2885-4747-9607-645268c47cb8', 'volume_size': 1} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 1073741824" returned: 0 in 1.040s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:35 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 Jul 08 11:28:35 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (a427b400-a68d-4618-b9a0-1486ace1769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f7641e-8ca2-4351-8681-7080fd863640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f7641e-8ca2-4351-8681-7080fd863640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762617462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425d25ff-cf83-40dc-bee1-b1be4f16339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9deef6f2-c392-45fa-b0f7-dd16bada1908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9deef6f2-c392-45fa-b0f7-dd16bada1908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4654f4b-f314-4f9a-925c-b1f2650d69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4654f4b-f314-4f9a-925c-b1f2650d69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425d25ff-cf83-40dc-bee1-b1be4f16339c', 'volume_name': 'volume-425d25ff-cf83-40dc-bee1-b1be4f16339c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ee8182-72a8-4647-91b2-60523895820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ee8182-72a8-4647-91b2-60523895820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4947d66-b26f-4a63-a8b0-bf568fe3e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:35 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume 425d25ff-cf83-40dc-bee1-b1be4f16339c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425d25ff-cf83-40dc-bee1-b1be4f16339c', 'volume_size': 1} Jul 08 11:28:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (76eec7f9-b7c4-457d-a9d5-cc2c45c5e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1f8fa0-82ad-4cf0-b481-2249b662a23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1f8fa0-82ad-4cf0-b481-2249b662a23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205291136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459b6efd-35a6-4df5-b0ba-443ad44ba03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1820faf-a940-4a52-a444-fb46725e6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1820faf-a940-4a52-a444-fb46725e6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5502e122-67fb-4920-af63-dd6e87e5c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5502e122-67fb-4920-af63-dd6e87e5c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459b6efd-35a6-4df5-b0ba-443ad44ba03a', 'volume_name': 'volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9262feb6-3ca8-4a11-9ef4-fb243a412357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9262feb6-3ca8-4a11-9ef4-fb243a412357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5eda86-144d-436b-a5af-4fbb19b28459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume 459b6efd-35a6-4df5-b0ba-443ad44ba03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a', 'volume_size': 1} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384" returned: 0 in 0.840s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927331822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8a67f4-2885-4747-9607-645268c47cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:35Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume 0b8a67f4-2885-4747-9607-645268c47cb8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:36 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020d944a-fff5-4844-bdaa-3ffccf4b23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 1073741824 Jul 08 11:28:36 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f07be2-11e2-4140-811e-17829e45b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Volume volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 (cae4b297-c085-4e3e-aa2a-faf76c9cc384): created successfully Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f07be2-11e2-4140-811e-17829e45b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Flow 'volume_create_manager' (3eb548a1-7908-46c4-a166-04a60e6aaa9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bab7fb57-6cff-42f5-b79e-f63a29971d8b tempest-VolumesMetadataTest-503673424 None] Created volume successfully. Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (f2825f73-3901-48c2-99b1-9571bdc37e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890659b5-f640-4a54-8fca-27c37bdc0bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890659b5-f640-4a54-8fca-27c37bdc0bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794307239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e0aa83-ec44-48e5-b1ce-a4ba7d553ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e0aa83-ec44-48e5-b1ce-a4ba7d553ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2332314-d9d9-4b04-83f4-8d86044c50d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2332314-d9d9-4b04-83f4-8d86044c50d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7', 'volume_name': 'volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39fba55-44b1-42bb-988b-c55a73e6f079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39fba55-44b1-42bb-988b-c55a73e6f079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd66263-c06e-49db-851b-3361c5a5d990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume 5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7', 'volume_size': 1} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Flow 'volume_create_manager' (a0db7531-6caf-4f27-8ad3-3ec7af51b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd5c46e-9f08-4082-b603-479abc506a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd5c46e-9f08-4082-b603-479abc506a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-83449576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080137fd-dc5f-4743-b48c-30fe8d7158af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4890817b6794e7e8d40e5fb0c3a0a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='0a1086060d7b4190b741b548b2d5dc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a9c3d1-3a30-4316-be3a-2f6e09fbb993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a9c3d1-3a30-4316-be3a-2f6e09fbb993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c3d513-c907-40a7-8e20-0cf1035985d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c3d513-c907-40a7-8e20-0cf1035985d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080137fd-dc5f-4743-b48c-30fe8d7158af', 'volume_name': 'volume-080137fd-dc5f-4743-b48c-30fe8d7158af', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008dfece-4846-4474-b3a8-b805dcb2cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008dfece-4846-4474-b3a8-b805dcb2cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05aa1fd9-7071-4a5a-ae49-0b8050da73ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume 080137fd-dc5f-4743-b48c-30fe8d7158af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080137fd-dc5f-4743-b48c-30fe8d7158af', 'volume_size': 1} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:37 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 1073741824" returned: 0 in 1.118s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:37 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 Jul 08 11:28:37 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Flow 'volume_create_manager' (86d03b85-1f33-46f3-afba-4ee2c011eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df7362-f824-4fb9-8a62-bb6d5b5cb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df7362-f824-4fb9-8a62-bb6d5b5cb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986790065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e0a09f-32c7-4ea0-86a6-29e7b33069d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4890817b6794e7e8d40e5fb0c3a0a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='0a1086060d7b4190b741b548b2d5dc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f120842d-7b87-4f89-a2c8-c02ac0ee35c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f120842d-7b87-4f89-a2c8-c02ac0ee35c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f29d46-2d8c-4a94-a5ab-db0725f2e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f29d46-2d8c-4a94-a5ab-db0725f2e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e0a09f-32c7-4ea0-86a6-29e7b33069d8', 'volume_name': 'volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e81ab34-5877-4415-890e-f572b9354c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e81ab34-5877-4415-890e-f572b9354c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38d9ec8-b942-42a0-b027-c353da684e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume 21e0a09f-32c7-4ea0-86a6-29e7b33069d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8', 'volume_size': 1} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (579fa583-1a36-4202-96f2-d94c19cdcb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20935e87-55f6-4fcd-be3e-5ff986fc81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20935e87-55f6-4fcd-be3e-5ff986fc81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114909051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f4e8ec-d542-4746-8e0f-da73fcb52cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f4e8ec-d542-4746-8e0f-da73fcb52cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa58794-5b9b-4c1c-b2f0-0ce8ee2f67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa58794-5b9b-4c1c-b2f0-0ce8ee2f67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f', 'volume_name': 'volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52151157-3dc1-4ca0-9f43-c650a4fc2791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52151157-3dc1-4ca0-9f43-c650a4fc2791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c951ca6-66b9-4bcf-a193-b10d71ffd003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:37 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f', 'volume_size': 1} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Acquiring lock "cinder-cae4b297-c085-4e3e-aa2a-faf76c9cc384-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "cinder-cae4b297-c085-4e3e-aa2a-faf76c9cc384-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Acquiring lock "cinder-quobyte-cae4b297-c085-4e3e-aa2a-faf76c9cc384" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "cinder-quobyte-cae4b297-c085-4e3e-aa2a-faf76c9cc384" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb32ec8c-102f-4393-89b3-39eb824c4bc2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:38 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 Jul 08 11:28:38 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:38 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.438s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762617462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425d25ff-cf83-40dc-bee1-b1be4f16339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume 425d25ff-cf83-40dc-bee1-b1be4f16339c {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:38 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:38 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c 1073741824 Jul 08 11:28:38 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8077220-8319-418a-96bf-4b2827143162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8a67f4-2885-4747-9607-645268c47cb8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9736ad-7afc-47f1-98e0-e833991eafe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:38 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-0b8a67f4-2885-4747-9607-645268c47cb8 (0b8a67f4-2885-4747-9607-645268c47cb8): created successfully Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9736ad-7afc-47f1-98e0-e833991eafe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (deda2908-681c-48ea-ac82-56f10b5c10e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-cee81c3d-0f7e-4f20-a6a0-169cca05a5f7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:38 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384" returned: 0 in 0.829s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:38 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384 Jul 08 11:28:38 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:39 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c 1073741824" returned: 0 in 0.909s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:39 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c Jul 08 11:28:39 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:39 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cae4b297-c085-4e3e-aa2a-faf76c9cc384" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "cinder-quobyte-cae4b297-c085-4e3e-aa2a-faf76c9cc384" released by "delete_volume" :: held 1.642s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Created reservations ['052e841f-c2fe-49ac-9a96-bdd9df6f7b27', 'ee34ae6a-56c7-4d4e-a140-19022df19e4b', '0de2ad91-0b5b-42fa-a003-467eddf63ab1', 'f0affe7c-e571-4322-b218-6dd9720f3aa2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:39 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:39 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:39 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c" returned: 0 in 0.722s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.724s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205291136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459b6efd-35a6-4df5-b0ba-443ad44ba03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume 459b6efd-35a6-4df5-b0ba-443ad44ba03a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:39 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:39 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a 1073741824 Jul 08 11:28:39 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4947d66-b26f-4a63-a8b0-bf568fe3e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425d25ff-cf83-40dc-bee1-b1be4f16339c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c0337f-e569-4079-b6f7-994954b3eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-425d25ff-cf83-40dc-bee1-b1be4f16339c (425d25ff-cf83-40dc-bee1-b1be4f16339c): created successfully Jul 08 11:28:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c0337f-e569-4079-b6f7-994954b3eca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (a427b400-a68d-4618-b9a0-1486ace1769d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-86bab515-b079-433b-9958-44befbb828d2 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:40 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.948s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Deleted volume successfully. Jul 08 11:28:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4b95382a-2296-40fa-b2d8-f686e9880cff tempest-VolumesMetadataTest-503673424 None] Lock "cinder-cae4b297-c085-4e3e-aa2a-faf76c9cc384-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:41 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a 1073741824" returned: 0 in 1.194s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:41 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a Jul 08 11:28:41 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:41 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794307239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:36Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume 5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:41 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5eda86-144d-436b-a5af-4fbb19b28459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:41 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 1073741824 Jul 08 11:28:41 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30820503-3953-4de1-bc9b-86f9b376c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a (459b6efd-35a6-4df5-b0ba-443ad44ba03a): created successfully Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30820503-3953-4de1-bc9b-86f9b376c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (76eec7f9-b7c4-457d-a9d5-cc2c45c5e4af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-06686e8d-fea0-4527-b913-e2416096045c tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:42 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 1073741824" returned: 0 in 0.951s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:42 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 Jul 08 11:28:42 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:43 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" returned: 0 in 0.685s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.532s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-83449576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080137fd-dc5f-4743-b48c-30fe8d7158af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4890817b6794e7e8d40e5fb0c3a0a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='0a1086060d7b4190b741b548b2d5dc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Creating volume 080137fd-dc5f-4743-b48c-30fe8d7158af {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:43 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:43 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af 1073741824 Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd66263-c06e-49db-851b-3361c5a5d990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:43 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53db35-0cca-4022-beb4-07fadc0d59cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:43 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 (5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7): created successfully Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53db35-0cca-4022-beb4-07fadc0d59cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (f2825f73-3901-48c2-99b1-9571bdc37e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:43 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-370b2178-3f09-4179-9d9c-ba0708c02b1d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:44 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af 1073741824" returned: 0 in 0.866s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:44 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af Jul 08 11:28:44 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:45 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.576s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986790065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e0a09f-32c7-4ea0-86a6-29e7b33069d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4890817b6794e7e8d40e5fb0c3a0a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='0a1086060d7b4190b741b548b2d5dc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Creating volume 21e0a09f-32c7-4ea0-86a6-29e7b33069d8 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:45 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:45 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 1073741824 Jul 08 11:28:45 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05aa1fd9-7071-4a5a-ae49-0b8050da73ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080137fd-dc5f-4743-b48c-30fe8d7158af', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01011464-2220-442c-a535-a4d79a54bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume volume-080137fd-dc5f-4743-b48c-30fe8d7158af (080137fd-dc5f-4743-b48c-30fe8d7158af): created successfully Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01011464-2220-442c-a535-a4d79a54bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Flow 'volume_create_manager' (a0db7531-6caf-4f27-8ad3-3ec7af51b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Flow 'volume_create_manager' (aa0a0494-f91e-45db-a017-b2d4564791b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04389bb-96c3-4651-b468-9afcc85129e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-807aed8c-98b3-4342-9508-ce129db5b71b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Created volume successfully. Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04389bb-96c3-4651-b468-9afcc85129e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495313407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb86069-f53d-4bdd-8441-f2aeea644383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60ec405e0d94e378a75ab4cdf2beeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:45Z,use_quota=True,user_id='9e76db5835bc4416b0b97bd940e3bdb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0eaf250-51d6-449b-a846-bf2937262117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0eaf250-51d6-449b-a846-bf2937262117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390cc39e-b0f1-4abf-9180-c9415bdf8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390cc39e-b0f1-4abf-9180-c9415bdf8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb86069-f53d-4bdd-8441-f2aeea644383', 'volume_name': 'volume-cdb86069-f53d-4bdd-8441-f2aeea644383', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdc3cd4-b901-4ecc-9fdf-536483b820fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdc3cd4-b901-4ecc-9fdf-536483b820fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b8a45-7dea-4f20-b2f6-d16271a50206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Volume cdb86069-f53d-4bdd-8441-f2aeea644383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb86069-f53d-4bdd-8441-f2aeea644383', 'volume_size': 1} Jul 08 11:28:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:46 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 1073741824" returned: 0 in 0.981s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:46 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 Jul 08 11:28:46 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:46 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.214s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2114909051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cedbecf704f4d549ff9ca7817b0af66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:37Z,use_quota=True,user_id='303c8562617f4aaea1fb2dd1dc66018a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Creating volume c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:46 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:46 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f 1073741824 Jul 08 11:28:46 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38d9ec8-b942-42a0-b027-c353da684e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aec397-8ef6-47b2-88ab-735a212bc656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Volume volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 (21e0a09f-32c7-4ea0-86a6-29e7b33069d8): created successfully Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aec397-8ef6-47b2-88ab-735a212bc656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Flow 'volume_create_manager' (86d03b85-1f33-46f3-afba-4ee2c011eb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f6c6f9ee-7a64-4a61-a422-7e77db62db27 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Created volume successfully. Jul 08 11:28:47 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f 1073741824" returned: 0 in 0.939s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:47 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f Jul 08 11:28:47 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:48 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.236s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495313407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb86069-f53d-4bdd-8441-f2aeea644383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60ec405e0d94e378a75ab4cdf2beeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:45Z,use_quota=True,user_id='9e76db5835bc4416b0b97bd940e3bdb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Creating volume cdb86069-f53d-4bdd-8441-f2aeea644383 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:48 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c951ca6-66b9-4bcf-a193-b10d71ffd003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a100c8-5409-486c-8697-0be13c021fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:48 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 1073741824 Jul 08 11:28:48 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:48 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Volume volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f (c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f): created successfully Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a100c8-5409-486c-8697-0be13c021fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Flow 'volume_create_manager' (579fa583-1a36-4202-96f2-d94c19cdcb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:48 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-babe2ec2-3c07-4a8c-9cfe-140c51ec56b9 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created volume successfully. Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[357972fe-f3a0-47cf-83e9-b15fe1ef8484]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:49 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f Jul 08 11:28:49 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:49 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 1073741824" returned: 0 in 0.931s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:49 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 Jul 08 11:28:49 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:50 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:50 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f Jul 08 11:28:50 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:50 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383" returned: 0 in 0.862s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07b8a45-7dea-4f20-b2f6-d16271a50206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb86069-f53d-4bdd-8441-f2aeea644383', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f374e96b-3e51-43b4-8113-bb4fce6eb4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Volume volume-cdb86069-f53d-4bdd-8441-f2aeea644383 (cdb86069-f53d-4bdd-8441-f2aeea644383): created successfully Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f374e96b-3e51-43b4-8113-bb4fce6eb4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Flow 'volume_create_manager' (aa0a0494-f91e-45db-a017-b2d4564791b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a06f3696-3772-4666-af29-1d616270a1b0 tempest-VolumesTransfersTest-256569755 None] Created volume successfully. Jul 08 11:28:51 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" returned: 0 in 0.805s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f" released by "delete_volume" :: held 1.813s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['4a131561-d5b5-4515-8c71-5828c724de16', '65ab1ad7-9124-4dbe-9ba1-049ac51b7498', '741b4f66-93ea-4807-b300-fb1a9a8e150d', 'b3dbf3c4-24de-4c08-a216-2c75c7ef141f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:51 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:51 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8e7ca5-2768-4f39-955a-a0b1418ee95f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:51 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 Jul 08 11:28:51 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:52 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.734s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-48ea2764-7bf5-4dfa-91cf-e308a7d43223 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-c6b6e4fe-4b39-4dbd-99ff-fb551a3ac45f-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:52 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:52 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c2bcaca4-3fb4-48d1-b66c-42ab982155e9 tempest-VolumesTransfersTest-749813961 None] Transfer volume completed successfully. Jul 08 11:28:52 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" returned: 0 in 0.989s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:52 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7 Jul 08 11:28:52 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:53 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.889s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:28:53 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" returned: 0 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7" released by "delete_volume" :: held 1.800s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "cinder-cdb86069-f53d-4bdd-8441-f2aeea644383-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-cdb86069-f53d-4bdd-8441-f2aeea644383-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "cinder-quobyte-cdb86069-f53d-4bdd-8441-f2aeea644383" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['f6d15e9c-f633-4316-bf9f-6b86d087b1b9', '177751b3-8051-4209-bbda-4e4d9e20973f', 'a419fe87-14cc-4cda-b618-3a76e36b7e68', 'dfac926d-7015-4478-8d3f-ac673a5192a0'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-quobyte-cdb86069-f53d-4bdd-8441-f2aeea644383" acquired by "delete_volume" :: waited 0.050s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630fc99-d169-4d3d-9bf9-4a1257bce243]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:53 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:53 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:53 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 Jul 08 11:28:53 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-459b6efd-35a6-4df5-b0ba-443ad44ba03a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-459b6efd-35a6-4df5-b0ba-443ad44ba03a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-459b6efd-35a6-4df5-b0ba-443ad44ba03a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-459b6efd-35a6-4df5-b0ba-443ad44ba03a" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b578bcd-a8e8-4a09-95c6-5e7c0e76b132]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:54 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a Jul 08 11:28:54 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:54 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383" returned: 0 in 1.044s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:54 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383 Jul 08 11:28:54 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:54 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.055s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:28:54 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b042f83-5014-4aaf-a8b1-d92740bdbf95 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-5bd00fd3-eb5d-4cf4-87f0-ae2f449c48c7-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:55 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a" returned: 0 in 1.148s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:55 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a Jul 08 11:28:55 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:55 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cdb86069-f53d-4bdd-8441-f2aeea644383" returned: 0 in 0.764s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-quobyte-cdb86069-f53d-4bdd-8441-f2aeea644383" released by "delete_volume" :: held 1.871s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=83,cinder:UPDATE=124,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Created reservations ['7f7dccda-3ebf-4668-b675-a9169628c97e', '86c5d10a-6ad1-4c19-b824-53e29b401c25', 'dfe641c8-79ae-4222-a99d-a6a584d11bcc', 'b3b1dc9f-d6f9-421b-826f-b1f42eaf5fc6'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:55 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:55 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:56 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-459b6efd-35a6-4df5-b0ba-443ad44ba03a" returned: 0 in 0.949s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-459b6efd-35a6-4df5-b0ba-443ad44ba03a" released by "delete_volume" :: held 2.182s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=95,cinder:INSERT=42,cinder:UPDATE=101,cinder:DELETE=12 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['0d1d5c19-71fb-460f-8c12-3d5ee55b20bd', 'dd391a54-9d28-455f-bf99-570575cc463f', 'bde4d665-9f98-437c-9c6a-c0172c490877', '6498fdaf-40ea-4426-a354-332d3ac04d92'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:56 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:56 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:56 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.129s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Deleted volume successfully. Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-9ce0f286-b830-44c0-8e74-2287d61a1750 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-cdb86069-f53d-4bdd-8441-f2aeea644383-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Flow 'volume_create_manager' (c9de8416-6871-4e32-9891-e3b8eb4f12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca4b21d-8e31-49e5-9e2e-6841d14bcd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca4b21d-8e31-49e5-9e2e-6841d14bcd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1287652867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e24cec3-94d9-4c89-be5e-554da0da4f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60ec405e0d94e378a75ab4cdf2beeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:57Z,use_quota=True,user_id='9e76db5835bc4416b0b97bd940e3bdb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da16e2-ce80-45b7-bd82-b79a6cadae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da16e2-ce80-45b7-bd82-b79a6cadae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a4255a-fc23-4752-998f-bc578decd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a4255a-fc23-4752-998f-bc578decd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e24cec3-94d9-4c89-be5e-554da0da4f71', 'volume_name': 'volume-4e24cec3-94d9-4c89-be5e-554da0da4f71', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd6bed-c232-42f6-b59d-aeb4c520634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd6bed-c232-42f6-b59d-aeb4c520634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68800139-feb5-419e-b605-6bed74937d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Volume 4e24cec3-94d9-4c89-be5e-554da0da4f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e24cec3-94d9-4c89-be5e-554da0da4f71', 'volume_size': 1} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1287652867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e24cec3-94d9-4c89-be5e-554da0da4f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60ec405e0d94e378a75ab4cdf2beeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:28:57Z,use_quota=True,user_id='9e76db5835bc4416b0b97bd940e3bdb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Creating volume 4e24cec3-94d9-4c89-be5e-554da0da4f71 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:28:57 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:57 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 1073741824 Jul 08 11:28:57 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-425d25ff-cf83-40dc-bee1-b1be4f16339c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-425d25ff-cf83-40dc-bee1-b1be4f16339c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:57 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.926s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:28:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d049155f-7f01-494e-9a53-5ebc859a3a65 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-459b6efd-35a6-4df5-b0ba-443ad44ba03a-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-425d25ff-cf83-40dc-bee1-b1be4f16339c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-425d25ff-cf83-40dc-bee1-b1be4f16339c" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2bcec3-0f85-4d77-9784-85ac2d301a6e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:57 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c Jul 08 11:28:57 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:57 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 1073741824" returned: 0 in 0.970s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:58 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 Jul 08 11:28:58 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:58 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c" returned: 0 in 0.958s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:58 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c Jul 08 11:28:58 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:58 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68800139-feb5-419e-b605-6bed74937d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e24cec3-94d9-4c89-be5e-554da0da4f71', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02830124-3dc1-4a31-b2d0-1464beb95674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:28:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Volume volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 (4e24cec3-94d9-4c89-be5e-554da0da4f71): created successfully Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02830124-3dc1-4a31-b2d0-1464beb95674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:28:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Flow 'volume_create_manager' (c9de8416-6871-4e32-9891-e3b8eb4f12a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:28:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1ce813dd-4a6c-467e-a78f-13d244635fb8 tempest-VolumesTransfersTest-256569755 None] Created volume successfully. Jul 08 11:28:59 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-425d25ff-cf83-40dc-bee1-b1be4f16339c" returned: 0 in 0.698s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-425d25ff-cf83-40dc-bee1-b1be4f16339c" released by "delete_volume" :: held 1.698s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['c73d38e8-bf92-44da-89e0-a99331dfa496', '9086ad00-ad25-4f0e-8029-f35761fcc041', 'e8944cd7-333b-4787-996a-a087dfa2b89b', '3746a1cb-9cfc-4d03-a54f-4240261fb549'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:59 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:28:59 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-0b8a67f4-2885-4747-9607-645268c47cb8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-0b8a67f4-2885-4747-9607-645268c47cb8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-0b8a67f4-2885-4747-9607-645268c47cb8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-0b8a67f4-2885-4747-9607-645268c47cb8" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4304ca-1403-465a-9515-d637e49aa026]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:28:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:28:59 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 Jul 08 11:28:59 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:00 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-20e04323-d260-41ec-9997-920e15151fd7 tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-425d25ff-cf83-40dc-bee1-b1be4f16339c-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "cinder-4e24cec3-94d9-4c89-be5e-554da0da4f71-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-4e24cec3-94d9-4c89-be5e-554da0da4f71-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "cinder-quobyte-4e24cec3-94d9-4c89-be5e-554da0da4f71" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-quobyte-4e24cec3-94d9-4c89-be5e-554da0da4f71" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb38703f-585b-4200-bbb7-c75f6990183f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:00 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 Jul 08 11:29:00 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:00 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8" returned: 0 in 0.869s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:00 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8 Jul 08 11:29:00 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:01 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71" returned: 0 in 0.780s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:01 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71 Jul 08 11:29:01 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:01 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0b8a67f4-2885-4747-9607-645268c47cb8" returned: 0 in 0.653s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-0b8a67f4-2885-4747-9607-645268c47cb8" released by "delete_volume" :: held 1.568s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['4bafcb8a-7bac-402d-bf62-4c9e59900a11', '564cb3dd-54d8-474c-8c9d-f10d1e2e6847', 'c2605e76-26ec-4b73-bd05-78594aa57cee', '336e2121-6a6f-4e37-b6bf-250abdb09482'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:01 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:01 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-9c9eed8d-b46b-43d9-9df7-d20d418bcd70-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:01 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e24cec3-94d9-4c89-be5e-554da0da4f71" returned: 0 in 0.787s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-quobyte-4e24cec3-94d9-4c89-be5e-554da0da4f71" released by "delete_volume" :: held 1.630s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-9c9eed8d-b46b-43d9-9df7-d20d418bcd70-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "cinder-quobyte-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:02 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec732de-96ac-4de7-8d07-08eee6577521]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Created reservations ['6661a49d-55d2-4c23-9b5a-e07896cb8c27', 'd859f88c-0183-4ca7-9aa0-c91ebb18cc8f', '8ae0aad1-ddbe-4890-ba71-6a33d9b61fc2', 'c18c90a8-98fa-4fe6-9eb4-f1c111c1cda5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-40bcddeb-79da-4585-b820-939bd867279b tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-0b8a67f4-2885-4747-9607-645268c47cb8-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:02 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 Jul 08 11:29:02 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:02 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:02 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:03 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.732s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Deleted volume successfully. Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ff8a6d9-35a0-42d4-abe9-e6c6c6c975e5 tempest-VolumesTransfersTest-1691610451 None] Lock "cinder-4e24cec3-94d9-4c89-be5e-554da0da4f71-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:03 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" returned: 0 in 0.970s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:03 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70 Jul 08 11:29:03 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:03 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-quobyte-9c9eed8d-b46b-43d9-9df7-d20d418bcd70" released by "delete_volume" :: held 1.733s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Created reservations ['bc9fddab-03bc-44fd-8eb0-91163399d4b5', '09d3ffee-7602-4489-bf09-bc489e4bf110', '43b97e97-3bba-4c76-8828-5410477264d4', '92a17367-a248-457a-85f2-17101b8f1b34'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:04 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:04 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:04 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.907s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:04 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Deleted volume successfully. Jul 08 11:29:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ebd10e9a-ba91-4e62-bd69-34f25742503d tempest-CreateVolumesFromSourceVolumeTest-1936934456 None] Lock "cinder-9c9eed8d-b46b-43d9-9df7-d20d418bcd70-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Flow 'volume_create_manager' (fd64bebb-a33f-4f21-b77d-a062434fa822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b2f9c-e0ef-488c-91c4-88b3c81c2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645b2f9c-e0ef-488c-91c4-88b3c81c2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300675899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ee35fe-391b-47ae-b4de-74af24700fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ca45f070d40af976042aa9cef7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:08Z,use_quota=True,user_id='3ece12790b764f049f44ba284643df0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1da843-e880-4932-9fdc-515b81d40b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1da843-e880-4932-9fdc-515b81d40b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030088be-b29a-4a60-9d06-480131b7ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030088be-b29a-4a60-9d06-480131b7ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ee35fe-391b-47ae-b4de-74af24700fdc', 'volume_name': 'volume-35ee35fe-391b-47ae-b4de-74af24700fdc', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354f48ba-076c-4b53-9ddc-6a91d00c0d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354f48ba-076c-4b53-9ddc-6a91d00c0d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45304cf3-2149-4e30-a628-9670219b819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Volume 35ee35fe-391b-47ae-b4de-74af24700fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ee35fe-391b-47ae-b4de-74af24700fdc', 'volume_size': 1} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300675899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ee35fe-391b-47ae-b4de-74af24700fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ca45f070d40af976042aa9cef7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:08Z,use_quota=True,user_id='3ece12790b764f049f44ba284643df0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Creating volume 35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:29:08 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:08 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc 1073741824 Jul 08 11:29:08 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:08 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc 1073741824" returned: 0 in 0.841s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:09 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:09 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:09 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 0.675s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45304cf3-2149-4e30-a628-9670219b819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ee35fe-391b-47ae-b4de-74af24700fdc', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d1222d-c05e-4024-b293-e7ed9cfe0dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Volume volume-35ee35fe-391b-47ae-b4de-74af24700fdc (35ee35fe-391b-47ae-b4de-74af24700fdc): created successfully Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d1222d-c05e-4024-b293-e7ed9cfe0dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Flow 'volume_create_manager' (fd64bebb-a33f-4f21-b77d-a062434fa822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-34504b81-7d74-4bd6-825e-340533b7aced tempest-VolumeDependencyTests-193155534 None] Created volume successfully. Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Flow 'volume_create_manager' (93ed04ab-c5c6-477d-80b4-b9a90ed23df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d5a72b-583e-476d-96b1-6955c22daf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d5a72b-583e-476d-96b1-6955c22daf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1347035303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12911ca5-633f-4a3b-bc45-abaa09c8b5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfe69737f754aa6b58983226bc6b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:10Z,use_quota=True,user_id='f00adf34bd7d40e9ac0d3d0d775f54f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a36f574-f735-4d36-b117-0718ab2495d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a36f574-f735-4d36-b117-0718ab2495d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e546d76-1b5a-4d0d-999c-1e7589134def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e546d76-1b5a-4d0d-999c-1e7589134def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12911ca5-633f-4a3b-bc45-abaa09c8b5ce', 'volume_name': 'volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec9f019-e1d9-4c9d-b1a7-343f13d8b6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec9f019-e1d9-4c9d-b1a7-343f13d8b6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38753049-62ab-44f0-bcbc-9a601a2c24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Volume 12911ca5-633f-4a3b-bc45-abaa09c8b5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce', 'volume_size': 1} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1347035303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12911ca5-633f-4a3b-bc45-abaa09c8b5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfe69737f754aa6b58983226bc6b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:10Z,use_quota=True,user_id='f00adf34bd7d40e9ac0d3d0d775f54f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Creating volume 12911ca5-633f-4a3b-bc45-abaa09c8b5ce {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:29:09 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:29:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:09 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce 1073741824 Jul 08 11:29:09 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:10 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce 1073741824" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:10 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce Jul 08 11:29:10 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:11 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" returned: 0 in 0.647s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.090s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38753049-62ab-44f0-bcbc-9a601a2c24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d2ad18-3960-41e4-a84c-878ddddb4989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Creating offline snapshot 79f10e7f-b47a-4649-8a05-807c656b0f6d of volume 35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:29:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Volume volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce (12911ca5-633f-4a3b-bc45-abaa09c8b5ce): created successfully Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d2ad18-3960-41e4-a84c-878ddddb4989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Flow 'volume_create_manager' (93ed04ab-c5c6-477d-80b4-b9a90ed23df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b547bf4-ada0-4a50-8851-10e6a1e8aeff]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-93ed20cc-1200-48d4-bdad-38bf56d71069 tempest-VolumesTransfersV357Test-285720136 None] Created volume successfully. Jul 08 11:29:11 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:11 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:12 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 0.790s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:12 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d 1G Jul 08 11:29:12 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-21ed6989-8972-439d-a3a6-e6185f37828f tempest-VolumesTransfersV357Test-1006548776 None] Transfer volume completed successfully. Jul 08 11:29:13 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d 1G" returned: 0 in 0.913s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee35fe-391b-47ae-b4de-74af24700fdc -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:13 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee35fe-391b-47ae-b4de-74af24700fdc -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:13 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "cinder-12911ca5-633f-4a3b-bc45-abaa09c8b5ce-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-12911ca5-633f-4a3b-bc45-abaa09c8b5ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "cinder-quobyte-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-quobyte-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20c1902-65e4-4fea-8db8-e432db563c3e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:13 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce Jul 08 11:29:13 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:13 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ee35fe-391b-47ae-b4de-74af24700fdc -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:13 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d is being set with open permissions: ugo+rw Jul 08 11:29:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:13 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:13 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:14 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" returned: 0 in 0.788s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:14 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce Jul 08 11:29:14 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:14 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:14 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info Jul 08 11:29:14 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:15 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-quobyte-12911ca5-633f-4a3b-bc45-abaa09c8b5ce" released by "delete_volume" :: held 1.513s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Created reservations ['3d17db8c-5108-4dc3-a021-d0c05fe93dab', 'ea146211-d36f-44fa-9838-e7c5591449a9', '63685bc9-f21b-41dc-a8c9-a1608c4453ae', 'ba720f1f-a64b-4ba1-9286-07612d89558d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:15 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:15 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:15 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:15 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info is being set with open permissions: ugo+rw Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:15 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info Jul 08 11:29:15 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:15 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Deleted volume successfully. Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-029eafbd-81b8-4494-adf3-9e5f8b9350d7 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-12911ca5-633f-4a3b-bc45-abaa09c8b5ce-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:15 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.info" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.577s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-443c7006-2c26-477c-b09e-5d6167009307 tempest-VolumeDependencyTests-193155534 None] Create snapshot completed successfully Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Flow 'volume_create_manager' (68718f47-acc7-4a3f-9a65-0e08a6d12ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e20616-1b84-41ed-900a-0978ddd175aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e20616-1b84-41ed-900a-0978ddd175aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-613240423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f847afc7-7212-4ce1-a7de-193508d243b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfe69737f754aa6b58983226bc6b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:16Z,use_quota=True,user_id='f00adf34bd7d40e9ac0d3d0d775f54f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ecab04-ac39-493f-ae34-3e57cc240edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ecab04-ac39-493f-ae34-3e57cc240edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edc14fd-b953-4b3a-9a7f-6d3acfcae0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edc14fd-b953-4b3a-9a7f-6d3acfcae0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f847afc7-7212-4ce1-a7de-193508d243b4', 'volume_name': 'volume-f847afc7-7212-4ce1-a7de-193508d243b4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b211e98-95f9-463b-98ef-7910950a2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b211e98-95f9-463b-98ef-7910950a2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dceab5-7a10-48d6-8443-6edb13656da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Volume f847afc7-7212-4ce1-a7de-193508d243b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f847afc7-7212-4ce1-a7de-193508d243b4', 'volume_size': 1} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-613240423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f847afc7-7212-4ce1-a7de-193508d243b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfe69737f754aa6b58983226bc6b956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:16Z,use_quota=True,user_id='f00adf34bd7d40e9ac0d3d0d775f54f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Creating volume f847afc7-7212-4ce1-a7de-193508d243b4 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:29:16 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:29:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:16 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 1073741824 Jul 08 11:29:16 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Flow 'volume_create_manager' (aa890385-3899-47f2-a91f-f2896ac5d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94fa29c-aa11-454e-a9b4-ce49c0e182ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 1073741824" returned: 0 in 0.962s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94fa29c-aa11-454e-a9b4-ce49c0e182ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-627777212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5802dcd3-69a9-4f2a-9ddc-26580f96e452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4ca45f070d40af976042aa9cef7a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79f10e7f-b47a-4649-8a05-807c656b0f6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:29:17Z,use_quota=True,user_id='3ece12790b764f049f44ba284643df0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dd5dce-bb87-42b0-bb71-9b90c2ad5fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8dd5dce-bb87-42b0-bb71-9b90c2ad5fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0476f8-e11c-421b-92f9-2d5bdd88a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0476f8-e11c-421b-92f9-2d5bdd88a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5802dcd3-69a9-4f2a-9ddc-26580f96e452', 'volume_name': 'volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452', 'volume_size': 1, 'snapshot_id': '79f10e7f-b47a-4649-8a05-807c656b0f6d'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b5b693-aa1e-4a70-847e-e97c09aa6199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b5b693-aa1e-4a70-847e-e97c09aa6199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865c70a4-00dc-40dd-8789-f5aae6a1d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Volume 5802dcd3-69a9-4f2a-9ddc-26580f96e452: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452', 'volume_size': 1, 'snapshot_id': '79f10e7f-b47a-4649-8a05-807c656b0f6d'} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:17 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 Jul 08 11:29:17 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:17 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.683s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d-5802dcd3-69a9-4f2a-9ddc-26580f96e452" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4dceab5-7a10-48d6-8443-6edb13656da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f847afc7-7212-4ce1-a7de-193508d243b4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2df339-f9fd-4309-8b7a-ed930ad50069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d-5802dcd3-69a9-4f2a-9ddc-26580f96e452" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Creating volume 5802dcd3-69a9-4f2a-9ddc-26580f96e452 from snapshot 79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Volume volume-f847afc7-7212-4ce1-a7de-193508d243b4 (f847afc7-7212-4ce1-a7de-193508d243b4): created successfully Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2df339-f9fd-4309-8b7a-ed930ad50069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Flow 'volume_create_manager' (68718f47-acc7-4a3f-9a65-0e08a6d12ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] snapshot: 79f10e7f-b47a-4649-8a05-807c656b0f6d, volume: 5802dcd3-69a9-4f2a-9ddc-26580f96e452, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c6a65205-71c8-4134-88cf-a269d16a55fd tempest-VolumesTransfersV357Test-285720136 None] Created volume successfully. Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a51b2c-0080-4528-a035-02ea3d213ba5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:18 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:18 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "cinder-f847afc7-7212-4ce1-a7de-193508d243b4-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-f847afc7-7212-4ce1-a7de-193508d243b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "cinder-quobyte-f847afc7-7212-4ce1-a7de-193508d243b4" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-quobyte-f847afc7-7212-4ce1-a7de-193508d243b4" acquired by "delete_volume" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e4987-8f88-41a3-b07e-c72357d3c01e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:18 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 Jul 08 11:29:18 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:18 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee35fe-391b-47ae-b4de-74af24700fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2afe7e-2187-44aa-a7de-64354325a544]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:19 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:19 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:19 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4" returned: 0 in 0.847s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:19 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4 Jul 08 11:29:19 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:19 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 0.846s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:19 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:29:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:19 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 Jul 08 11:29:19 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:20 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f847afc7-7212-4ce1-a7de-193508d243b4" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-quobyte-f847afc7-7212-4ce1-a7de-193508d243b4" released by "delete_volume" :: held 1.620s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Created reservations ['0682a1d1-494f-4c24-a753-a103e8e5aba7', 'c18c7997-8b6b-4c33-b7ed-82ccef7bf887', '02d03084-0713-4924-b648-8ef4b83a046d', '970cdba8-54dc-4343-b58c-e4d67c89c25c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:20 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:20 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:21 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.216s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:21 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Deleted volume successfully. Jul 08 11:29:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ef5b0323-d328-437e-9c73-e52ec05f9012 tempest-VolumesTransfersV357Test-1110113265 None] Lock "cinder-f847afc7-7212-4ce1-a7de-193508d243b4-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:25 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452" returned: 0 in 5.484s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:25 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[de058714-c631-4dba-9240-5f2bf10c2fd2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:25 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:25 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:26 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 1.003s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:29:26 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Converted 1024.00 MB image at 186.68 MB/s Jul 08 11:29:26 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 is being set with open permissions: ugo+rw Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:26 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 Jul 08 11:29:26 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:26 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452" returned: 0 in 0.720s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" released by "_copy_volume_from_snapshot" :: held 8.947s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d-5802dcd3-69a9-4f2a-9ddc-26580f96e452" released by "_create_volume_from_snapshot" :: held 8.990s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.023s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.519s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e7589-ac56-47bd-bafb-270ffeda3cb9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865c70a4-00dc-40dd-8789-f5aae6a1d062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452', 'volume_size': 1, 'snapshot_id': '79f10e7f-b47a-4649-8a05-807c656b0f6d'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee50b2b4-4685-4f57-b8d1-3cc74f089ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:29:27 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Volume volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 (5802dcd3-69a9-4f2a-9ddc-26580f96e452): created successfully Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee50b2b4-4685-4f57-b8d1-3cc74f089ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Flow 'volume_create_manager' (aa890385-3899-47f2-a91f-f2896ac5d26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:29:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fdfbc472-dc63-464c-b436-db46b17b9ed9 tempest-VolumeDependencyTests-193155534 None] Created volume successfully. Jul 08 11:29:27 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af Jul 08 11:29:27 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:27 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af" returned: 0 in 0.801s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-080137fd-dc5f-4743-b48c-30fe8d7158af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '799f3d51-6343-48dc-b858-e17bfe0445ef', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:29:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-e5910e9f-fdc4-4136-bbef-7320b7df7aa6 req-cb643d11-c041-4685-a3a0-6d5875adbf8b tempest-TestServerVolumeAttachmentScenario-1218357276 None] attachment_update completed successfully. Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-79f10e7f-b47a-4649-8a05-807c656b0f6d-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-79f10e7f-b47a-4649-8a05-807c656b0f6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Deleting offline snapshot 79f10e7f-b47a-4649-8a05-807c656b0f6d of volume 35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] snapshot_file for this snap is: volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25121f-9723-4781-beb0-017dfd5e70f7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:28 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:28 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:29 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.830s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ee35fe-391b-47ae-b4de-74af24700fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d8c23-5adf-45b8-9664-719551551072]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:29 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:29 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:29 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:30 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:30 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:30 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.768s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:30 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d Jul 08 11:29:30 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:31 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc.79f10e7f-b47a-4649-8a05-807c656b0f6d" returned: 0 in 0.710s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-79f10e7f-b47a-4649-8a05-807c656b0f6d" released by "_delete_snapshot" :: held 3.248s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" released by "delete_snapshot" :: held 3.286s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:31 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Created reservations ['8c25cde3-1f70-409d-a7b9-e7ba234c1236', '7495870e-602d-42de-a4ec-beb0e642c712', '54029fb5-5f27-420d-8795-5db2361ffc04', '141ce65c-69ac-49d7-8f77-b9256cbee14f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Delete snapshot completed successfully. Jul 08 11:29:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4faaaa28-6dde-43eb-8012-0e0c38af048a tempest-VolumeDependencyTests-193155534 None] Lock "cinder-79f10e7f-b47a-4649-8a05-807c656b0f6d-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-35ee35fe-391b-47ae-b4de-74af24700fdc-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-35ee35fe-391b-47ae-b4de-74af24700fdc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd86f4a-e387-483d-b51c-b09f9a30a316]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:32 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:32 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:33 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 0.884s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:33 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc Jul 08 11:29:33 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:34 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-35ee35fe-391b-47ae-b4de-74af24700fdc" returned: 0 in 1.041s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-35ee35fe-391b-47ae-b4de-74af24700fdc" released by "delete_volume" :: held 2.008s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Created reservations ['bae31b81-6b14-45dd-b2ad-49f655d99393', '895e18fb-c5e5-451d-883a-1d7d9621d0d8', '1bdec20c-84e2-4e55-98c0-7089a5b7fb79', 'b0cb0a9b-7a1f-4f57-b781-3a8cfed83854'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:34 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:34 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-5802dcd3-69a9-4f2a-9ddc-26580f96e452-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "cinder-5802dcd3-69a9-4f2a-9ddc-26580f96e452-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Acquiring lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3c1ac0-fde0-4a87-8b04-8fbb617b0d4a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:35 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 Jul 08 11:29:35 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:35 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.945s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Deleted volume successfully. Jul 08 11:29:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a4bf92b5-2bdb-4013-a61c-05ba176139d2 tempest-VolumeDependencyTests-193155534 None] Lock "cinder-35ee35fe-391b-47ae-b4de-74af24700fdc-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:36 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452" returned: 0 in 1.088s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:36 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452 Jul 08 11:29:36 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:36 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5802dcd3-69a9-4f2a-9ddc-26580f96e452" returned: 0 in 0.694s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "cinder-quobyte-5802dcd3-69a9-4f2a-9ddc-26580f96e452" released by "delete_volume" :: held 1.836s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Created reservations ['023c8846-1c39-477b-bf7b-19a6b7b48193', 'a8f2aebc-6395-4a84-adfc-4602c4cff6b0', 'c791b2be-429f-4cef-b958-3055d8d051fe', '26c7b83f-0ebf-459c-9860-9306bdb8a382'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:37 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:37 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:37 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Deleted volume successfully. Jul 08 11:29:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8f3d5ff4-1b7b-4c33-a91b-5c001063703b tempest-VolumeDependencyTests-193155534 None] Lock "cinder-5802dcd3-69a9-4f2a-9ddc-26580f96e452-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:29:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[67208dea-4aab-4097-97b9-6671e1d744a3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:39 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 Jul 08 11:29:39 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:40 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec4e5aba-fb64-437a-98d2-62f85153c099', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:29:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-7bf0b193-e4f5-4b02-bc9c-254623a4c8a9 req-41069ca2-4cfb-4bdd-a42c-ed98e658ec41 tempest-TestServerVolumeAttachmentScenario-1218357276 None] attachment_update completed successfully. Jul 08 11:29:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-eff80f6b-523a-4ec9-ae6a-0e6a62f8ccf0 req-1b16f4ba-269a-45ca-9a72-266db16a78db tempest-TestServerVolumeAttachmentScenario-1218357276 None] Terminate volume connection completed successfully. Jul 08 11:29:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-eff80f6b-523a-4ec9-ae6a-0e6a62f8ccf0 req-1b16f4ba-269a-45ca-9a72-266db16a78db tempest-TestServerVolumeAttachmentScenario-1218357276 None] Deleting attachment ec4e5aba-fb64-437a-98d2-62f85153c099. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:29:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-34509496-a596-4b7c-a33a-2435a565d967 req-5633c6bc-09c0-4b7b-9861-2b4d7b4e3e2a tempest-TestServerVolumeAttachmentScenario-1218357276 None] Terminate volume connection completed successfully. Jul 08 11:29:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-34509496-a596-4b7c-a33a-2435a565d967 req-5633c6bc-09c0-4b7b-9861-2b4d7b4e3e2a tempest-TestServerVolumeAttachmentScenario-1218357276 None] Deleting attachment 799f3d51-6343-48dc-b858-e17bfe0445ef. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:52 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:29:52 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:29:52 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:29:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "cinder-21e0a09f-32c7-4ea0-86a6-29e7b33069d8-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-21e0a09f-32c7-4ea0-86a6-29e7b33069d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=80,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:INSERT=25,cinder:UPDATE=111,cinder:SELECT=77,cinder:DELETE=9 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "cinder-quobyte-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-quobyte-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc5f5b-2bfc-44cd-ab69-aecf4f2c3ef7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:29:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:29:59 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 Jul 08 11:29:59 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:00 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" returned: 0 in 0.840s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:00 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8 Jul 08 11:30:00 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:01 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" returned: 0 in 0.716s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-quobyte-21e0a09f-32c7-4ea0-86a6-29e7b33069d8" released by "delete_volume" :: held 1.635s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Created reservations ['ce35dc79-08a8-4460-98b4-ad8813abf169', 'd9f6ec0b-5a60-4dde-8708-9b93022b06e9', '4e5c0935-c4b1-4217-916c-0486e554dbcc', '3840e08b-c783-45f5-860b-b6c6466df0fb'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:01 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:30:01 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "cinder-080137fd-dc5f-4743-b48c-30fe8d7158af-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-080137fd-dc5f-4743-b48c-30fe8d7158af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "cinder-quobyte-080137fd-dc5f-4743-b48c-30fe8d7158af" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-quobyte-080137fd-dc5f-4743-b48c-30fe8d7158af" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c17f37-9815-4206-8c2e-98223f9143da]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:02 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af Jul 08 11:30:02 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:02 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:30:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Deleted volume successfully. Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e7a78f8f-c846-4d31-8dba-3c1256dcc39f tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-21e0a09f-32c7-4ea0-86a6-29e7b33069d8-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:02 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af" returned: 0 in 0.938s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:02 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af Jul 08 11:30:02 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:03 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-080137fd-dc5f-4743-b48c-30fe8d7158af" returned: 0 in 0.701s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-quobyte-080137fd-dc5f-4743-b48c-30fe8d7158af" released by "delete_volume" :: held 1.687s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Created reservations ['2db69862-28fd-4e29-8b25-c93f8f3bdf27', 'ef8a3672-4280-47ba-ba33-51c362a9691e', '681764e0-461d-42b3-ba98-5667eecba1c5', '12a2479a-f319-4290-a56d-bb95e0d72416'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:03 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:30:03 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:04 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:04 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:30:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Deleted volume successfully. Jul 08 11:30:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8a0c8c9f-00d6-4b06-9ea0-4e8fa01eaea2 tempest-TestServerVolumeAttachmentScenario-1218357276 None] Lock "cinder-080137fd-dc5f-4743-b48c-30fe8d7158af-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Flow 'volume_create_manager' (4b1cf17a-a58b-4a81-836a-abc1bf57eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bb72d5-e74b-4475-8add-ccf5ac1091c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bb72d5-e74b-4475-8add-ccf5ac1091c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1031013862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835e5954-36d3-43fd-8c85-308bdbdf8d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13911fae419a4508a5548df69d08840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:05Z,use_quota=True,user_id='cc1ea1d8716e41c5bcfddc85d28a9568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f4bca0-cd6a-45a0-9c8b-b2993ef52933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f4bca0-cd6a-45a0-9c8b-b2993ef52933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2596463-8785-4f8c-99ad-dd813550a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2596463-8785-4f8c-99ad-dd813550a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835e5954-36d3-43fd-8c85-308bdbdf8d47', 'volume_name': 'volume-835e5954-36d3-43fd-8c85-308bdbdf8d47', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eab7a61-ed51-4411-9fac-b66a4f9f614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eab7a61-ed51-4411-9fac-b66a4f9f614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd438207-f6dc-4523-9da1-af7a8b47d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Volume 835e5954-36d3-43fd-8c85-308bdbdf8d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835e5954-36d3-43fd-8c85-308bdbdf8d47', 'volume_size': 1} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1031013862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835e5954-36d3-43fd-8c85-308bdbdf8d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13911fae419a4508a5548df69d08840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:05Z,use_quota=True,user_id='cc1ea1d8716e41c5bcfddc85d28a9568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Creating volume 835e5954-36d3-43fd-8c85-308bdbdf8d47 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:30:05 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:30:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:05 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 1073741824 Jul 08 11:30:05 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:06 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 1073741824" returned: 0 in 0.882s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:06 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 Jul 08 11:30:06 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:06 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47" returned: 0 in 0.695s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd438207-f6dc-4523-9da1-af7a8b47d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835e5954-36d3-43fd-8c85-308bdbdf8d47', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9785dfc7-694f-40b2-8e52-8880d709cea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Volume volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 (835e5954-36d3-43fd-8c85-308bdbdf8d47): created successfully Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9785dfc7-694f-40b2-8e52-8880d709cea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Flow 'volume_create_manager' (4b1cf17a-a58b-4a81-836a-abc1bf57eceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3942b344-e497-46a0-a484-f63ee0a0541f tempest-TestMinimumBasicScenario-1642113248 None] Created volume successfully. Jul 08 11:30:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[21425c2e-0c4b-4568-a8ac-a5c9553467c4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:10 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 Jul 08 11:30:10 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:11 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47" returned: 0 in 0.955s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-835e5954-36d3-43fd-8c85-308bdbdf8d47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66408ca0-45db-4919-9af1-62782e3c165d', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:30:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-3119ebc1-d3c6-4389-9d88-7f65d40e961a req-fc2ab0bf-1836-4a52-8b55-b913d4c3a29f tempest-TestMinimumBasicScenario-1642113248 None] attachment_update completed successfully. Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Flow 'volume_create_manager' (aa3ada98-a436-41c4-9174-852755f59487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c0bc93-0801-47e3-9969-c336629c6633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c0bc93-0801-47e3-9969-c336629c6633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4777b71-2484-405e-8228-be011d93ce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c08ddccdbd45dc8a5455aea216499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:15Z,use_quota=True,user_id='1ba1ae84b06f40c99de6324dd32acfc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e37892b-476a-4be4-9e5b-80802035afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e37892b-476a-4be4-9e5b-80802035afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf830ac-80ce-4681-b562-ebffb75699c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf830ac-80ce-4681-b562-ebffb75699c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4777b71-2484-405e-8228-be011d93ce40', 'volume_name': 'volume-b4777b71-2484-405e-8228-be011d93ce40', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4d6baa-d56b-4841-aa9f-50967af771f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4d6baa-d56b-4841-aa9f-50967af771f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59bc210-bf24-4ae4-9254-a75fe276d033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Volume b4777b71-2484-405e-8228-be011d93ce40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4777b71-2484-405e-8228-be011d93ce40', 'volume_size': 1} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4777b71-2484-405e-8228-be011d93ce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c08ddccdbd45dc8a5455aea216499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:15Z,use_quota=True,user_id='1ba1ae84b06f40c99de6324dd32acfc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Creating volume b4777b71-2484-405e-8228-be011d93ce40 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:30:15 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:30:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:15 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 1073741824 Jul 08 11:30:15 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:16 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 1073741824" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:16 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 Jul 08 11:30:16 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:16 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40" returned: 0 in 0.668s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59bc210-bf24-4ae4-9254-a75fe276d033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4777b71-2484-405e-8228-be011d93ce40', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b321fc1-5353-46c0-a11e-8395a18cd7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Volume volume-b4777b71-2484-405e-8228-be011d93ce40 (b4777b71-2484-405e-8228-be011d93ce40): created successfully Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b321fc1-5353-46c0-a11e-8395a18cd7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Flow 'volume_create_manager' (aa3ada98-a436-41c4-9174-852755f59487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fe1ea512-321f-41eb-9f14-9ab61116055d tempest-CinderUnicodeTest-1053393360 None] Created volume successfully. Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Flow 'volume_create_manager' (edc33240-322f-4cd9-8970-6b903b15cae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bc4ff1-ecbe-47bc-b087-b91740085f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bc4ff1-ecbe-47bc-b087-b91740085f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1376352206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a890078d-5b01-4e1f-999b-ebeb0b35ba5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c08ddccdbd45dc8a5455aea216499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:18Z,use_quota=True,user_id='1ba1ae84b06f40c99de6324dd32acfc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be19c9e-a778-483f-bcc2-857afdd9ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be19c9e-a778-483f-bcc2-857afdd9ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05639fc3-65ac-488f-bde4-51a8ae7c8f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05639fc3-65ac-488f-bde4-51a8ae7c8f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a890078d-5b01-4e1f-999b-ebeb0b35ba5d', 'volume_name': 'volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6856a-b1ed-4e79-9e80-331a8e910ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf6856a-b1ed-4e79-9e80-331a8e910ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b46b14d-f888-4f86-87ef-a53623e945f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:17 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Volume a890078d-5b01-4e1f-999b-ebeb0b35ba5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d', 'volume_size': 1} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:30:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1376352206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a890078d-5b01-4e1f-999b-ebeb0b35ba5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c08ddccdbd45dc8a5455aea216499a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:30:18Z,use_quota=True,user_id='1ba1ae84b06f40c99de6324dd32acfc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Creating volume a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:30:17 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:30:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:17 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d 1073741824 Jul 08 11:30:17 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:18 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d 1073741824" returned: 0 in 0.860s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:18 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d Jul 08 11:30:18 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:19 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" returned: 0 in 0.724s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b46b14d-f888-4f86-87ef-a53623e945f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02bff97-63f9-43ce-b334-428100308fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:30:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Volume volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d (a890078d-5b01-4e1f-999b-ebeb0b35ba5d): created successfully Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02bff97-63f9-43ce-b334-428100308fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:30:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Flow 'volume_create_manager' (edc33240-322f-4cd9-8970-6b903b15cae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:30:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-52241d5b-7570-41b6-9b09-7dbed13cd7f6 tempest-CinderUnicodeTest-1053393360 None] Created volume successfully. Jul 08 11:30:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Creating offline snapshot a1d73c74-3904-449a-b529-2659f1e433de of volume a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:30:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1717c65-5da1-4b32-8e2b-cbf9ae0c805b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:20 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d Jul 08 11:30:20 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:21 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" returned: 0 in 0.825s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:21 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de 1G Jul 08 11:30:21 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:22 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de 1G" returned: 0 in 0.943s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:22 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de Jul 08 11:30:22 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:22 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:22 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de is being set with open permissions: ugo+rw Jul 08 11:30:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:22 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de Jul 08 11:30:22 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:23 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:23 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info Jul 08 11:30:23 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:24 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info" returned: 0 in 0.652s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:24 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info is being set with open permissions: ugo+rw Jul 08 11:30:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:24 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info Jul 08 11:30:24 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:24 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.info" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-31f798e3-8cb2-4886-bd48-c2a302521096 tempest-CinderUnicodeTest-1053393360 None] Create snapshot completed successfully Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-a1d73c74-3904-449a-b529-2659f1e433de-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-a1d73c74-3904-449a-b529-2659f1e433de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-quobyte-a1d73c74-3904-449a-b529-2659f1e433de" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a1d73c74-3904-449a-b529-2659f1e433de" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Deleting offline snapshot a1d73c74-3904-449a-b529-2659f1e433de of volume a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] snapshot_file for this snap is: volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420cb8e-5860-4c93-a86d-128860927a59]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:25 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de Jul 08 11:30:25 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:26 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de" returned: 0 in 0.758s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:30:26 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[43660014-3dd9-4718-a465-34eeffa1a11a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:26 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d Jul 08 11:30:26 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:27 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" returned: 0 in 0.772s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:27 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de Jul 08 11:30:27 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:27 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de" returned: 0 in 0.771s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:27 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de Jul 08 11:30:27 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:28 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d.a1d73c74-3904-449a-b529-2659f1e433de" returned: 0 in 0.653s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a1d73c74-3904-449a-b529-2659f1e433de" released by "_delete_snapshot" :: held 3.065s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" released by "delete_snapshot" :: held 3.088s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:28 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Created reservations ['a666775b-c882-4ba6-bf46-29bfe5351f2f', 'e598a948-2251-4dee-bdda-c2227f348814', 'b803916d-27e4-47ff-9fa3-5a8d6122ff82', '65fa1a11-ad8c-47b4-9698-f4c5a984b61c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:30:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Delete snapshot completed successfully. Jul 08 11:30:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7423141-5c10-480f-8e2f-8c4b3a5e6db0 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-a1d73c74-3904-449a-b529-2659f1e433de-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-a890078d-5b01-4e1f-999b-ebeb0b35ba5d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-a890078d-5b01-4e1f-999b-ebeb0b35ba5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6944dc-6c82-4655-b297-c86eacfdfa8f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:29 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d Jul 08 11:30:29 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:30 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" returned: 0 in 0.743s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:30 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d Jul 08 11:30:30 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:31 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" returned: 0 in 0.630s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-a890078d-5b01-4e1f-999b-ebeb0b35ba5d" released by "delete_volume" :: held 1.429s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Created reservations ['35e0e202-ee5a-4fc1-b788-b93a1cc2d687', '2b269306-73bc-459f-aba5-bfc16d0c8867', 'ea9bb3ea-3354-455a-bcbd-0576eb1d638b', 'e32bce65-09c9-42a7-b115-09a7591f3a1b'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:31 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:30:31 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-b4777b71-2484-405e-8228-be011d93ce40-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-b4777b71-2484-405e-8228-be011d93ce40-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "cinder-quobyte-b4777b71-2484-405e-8228-be011d93ce40" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-b4777b71-2484-405e-8228-be011d93ce40" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:32 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.696s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:30:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Deleted volume successfully. Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[067fd757-396d-4b51-ad35-02fbbc3caece]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ec574d6a-31f0-4da8-89fb-864452b2a161 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-a890078d-5b01-4e1f-999b-ebeb0b35ba5d-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:32 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 Jul 08 11:30:32 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:32 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40" returned: 0 in 0.791s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:32 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40 Jul 08 11:30:32 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:33 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b4777b71-2484-405e-8228-be011d93ce40" returned: 0 in 0.706s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-quobyte-b4777b71-2484-405e-8228-be011d93ce40" released by "delete_volume" :: held 1.552s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Created reservations ['699f2767-0840-4c2c-8ed4-cbb7645f39dc', 'ded27a5f-a89a-4c98-a58b-49a4d59b8da4', '8e35fdb1-4a0b-4a00-8e4c-4d3afe8cce04', 'ff027247-8398-40f9-891b-f3ce8951f030'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:33 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:30:33 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:34 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.714s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:34 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:30:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Deleted volume successfully. Jul 08 11:30:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-75076f71-38d7-465f-85d0-da5592685a18 tempest-CinderUnicodeTest-1053393360 None] Lock "cinder-b4777b71-2484-405e-8228-be011d93ce40-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:30:43 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=58,cinder:DELETE=3 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:30:44 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:52 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:30:52 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:30:52 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:30:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:30:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-b8ed9e69-0181-4a1d-b0ff-55a8fb5e5765 req-6bb9dabe-1d9b-4cc4-b14a-39396cbbc6be tempest-TestMinimumBasicScenario-1642113248 None] Terminate volume connection completed successfully. Jul 08 11:30:57 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-b8ed9e69-0181-4a1d-b0ff-55a8fb5e5765 req-6bb9dabe-1d9b-4cc4-b14a-39396cbbc6be tempest-TestMinimumBasicScenario-1642113248 None] Deleting attachment 66408ca0-45db-4919-9af1-62782e3c165d. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "cinder-835e5954-36d3-43fd-8c85-308bdbdf8d47-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "cinder-835e5954-36d3-43fd-8c85-308bdbdf8d47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "cinder-quobyte-835e5954-36d3-43fd-8c85-308bdbdf8d47" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "cinder-quobyte-835e5954-36d3-43fd-8c85-308bdbdf8d47" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f7be8b-1a45-440b-919b-a9497f2d0988]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:30:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:30:59 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 Jul 08 11:30:59 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:00 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:31:00 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47 Jul 08 11:31:00 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:00 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-835e5954-36d3-43fd-8c85-308bdbdf8d47" returned: 0 in 0.624s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "cinder-quobyte-835e5954-36d3-43fd-8c85-308bdbdf8d47" released by "delete_volume" :: held 1.398s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Created reservations ['004f63c6-c979-4b9c-b8a3-6acb506fc35a', '0e6e8ad9-959d-4e02-8b28-ac6c3cc26678', '8e0ae105-da7e-446f-875a-da61a4314a9d', 'b4f1286c-4d9e-4fee-9758-b0b6f06747c8'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:31:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:31:00 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:31:00 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:01 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.627s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:01 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:31:01 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Deleted volume successfully. Jul 08 11:31:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b4e5ffbe-16b3-4bc0-9641-8f4d9c69a147 tempest-TestMinimumBasicScenario-1642113248 None] Lock "cinder-835e5954-36d3-43fd-8c85-308bdbdf8d47-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:31:10 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:31:11 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Flow 'volume_create_manager' (3e0f1f8b-5e26-4b02-a311-5fedc75d8f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e16957-fa44-46d9-abcf-1702ccc504f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e16957-fa44-46d9-abcf-1702ccc504f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-107768854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2c5b05-7ccb-43df-86ac-87a63e52d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213209f401524c4c820aeb7488faf36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:31:39Z,use_quota=True,user_id='35223627de4c47e1be3318f3c8bbe4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73876aa6-731a-40ad-8e39-8f54913d6902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73876aa6-731a-40ad-8e39-8f54913d6902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26fc9f1-ec31-4400-90c2-d05b909a4323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26fc9f1-ec31-4400-90c2-d05b909a4323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2c5b05-7ccb-43df-86ac-87a63e52d8e0', 'volume_name': 'volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defd6d49-8070-4e08-bebb-aa215561c09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defd6d49-8070-4e08-bebb-aa215561c09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64006bcc-4703-40a5-b093-26237ec4801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Volume 5d2c5b05-7ccb-43df-86ac-87a63e52d8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0', 'volume_size': 1} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-107768854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2c5b05-7ccb-43df-86ac-87a63e52d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213209f401524c4c820aeb7488faf36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:31:39Z,use_quota=True,user_id='35223627de4c47e1be3318f3c8bbe4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Creating volume 5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:31:39 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:31:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:31:39 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 1073741824 Jul 08 11:31:39 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:40 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 1073741824" returned: 0 in 0.900s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:31:40 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:31:40 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:40 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64006bcc-4703-40a5-b093-26237ec4801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbf60a1-eff7-4a77-9da1-9ce3d607b862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:31:40 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Volume volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 (5d2c5b05-7ccb-43df-86ac-87a63e52d8e0): created successfully Jul 08 11:31:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbf60a1-eff7-4a77-9da1-9ce3d607b862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:31:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Flow 'volume_create_manager' (3e0f1f8b-5e26-4b02-a311-5fedc75d8f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:31:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4349e23a-6d4f-4ae5-9e52-952d21f250b9 tempest-TestStampPattern-1067233557 None] Created volume successfully. Jul 08 11:31:51 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:31:51 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:31:52 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:31:52 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:31:52 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.695s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:31:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:31:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:31:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:31:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:32:13 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:32:13 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:32:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:18 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3c8165-9278-4908-8a8e-d0d9bc667c98]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:32:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:18 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:32:18 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:19 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.761s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.783s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '167066b3-8340-4068-93ad-9841e112cfa1', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:32:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-d751d4a9-bc1b-4ee4-8286-52df7ef14b1d req-b7419224-49ae-47ac-92b7-0bbbab1ef0f2 tempest-TestStampPattern-1067233557 None] attachment_update completed successfully. Jul 08 11:32:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-c96e10c7-42e6-4a27-97aa-b444454ae31c req-eaf569f8-308b-4ebf-b54d-e57ec17fe807 tempest-TestStampPattern-1067233557 None] Terminate volume connection completed successfully. Jul 08 11:32:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-c96e10c7-42e6-4a27-97aa-b444454ae31c req-eaf569f8-308b-4ebf-b54d-e57ec17fe807 tempest-TestStampPattern-1067233557 None] Deleting attachment 167066b3-8340-4068-93ad-9841e112cfa1. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:32:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Creating offline snapshot 856cf150-3a8c-4741-b3b0-f293e6bd1f91 of volume 5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:32:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e32dc2c-6c12-4664-a545-955b34b186b6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:32:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:29 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:32:29 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:30 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.742s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:30 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 1G Jul 08 11:32:30 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:31 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 1G" returned: 0 in 0.776s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:31 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:32:31 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:31 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:31 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 is being set with open permissions: ugo+rw Jul 08 11:32:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:32 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:32:32 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:32 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.625s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:32 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info Jul 08 11:32:32 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:33 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:33 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info is being set with open permissions: ugo+rw Jul 08 11:32:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:33 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info Jul 08 11:32:33 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:33 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.info" returned: 0 in 0.641s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a7904d90-342d-4579-8c65-ac44f60c70a1 tempest-TestStampPattern-1067233557 None] Create snapshot completed successfully Jul 08 11:32:43 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:32:43 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Flow 'volume_create_manager' (40552c13-0f9d-4b2e-9c54-6529f4292a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a86a49-be95-4834-a08a-1ab529a0e862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a86a49-be95-4834-a08a-1ab529a0e862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1714736836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e99294d-0d69-4e00-a0ad-b798eb726dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213209f401524c4c820aeb7488faf36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=856cf150-3a8c-4741-b3b0-f293e6bd1f91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:32:45Z,use_quota=True,user_id='35223627de4c47e1be3318f3c8bbe4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1366a2d-e8ba-42fd-aa64-a3a213016c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1366a2d-e8ba-42fd-aa64-a3a213016c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a8f0b-556b-4fc2-bc11-2b283c482c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a8f0b-556b-4fc2-bc11-2b283c482c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e99294d-0d69-4e00-a0ad-b798eb726dfd', 'volume_name': 'volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd', 'volume_size': 1, 'snapshot_id': '856cf150-3a8c-4741-b3b0-f293e6bd1f91'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e58cfaa-0f83-47db-a191-c853153c064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e58cfaa-0f83-47db-a191-c853153c064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfd2eca-cf4b-4b6a-a7cc-d4b4b0402412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Volume 4e99294d-0d69-4e00-a0ad-b798eb726dfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd', 'volume_size': 1, 'snapshot_id': '856cf150-3a8c-4741-b3b0-f293e6bd1f91'} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91-4e99294d-0d69-4e00-a0ad-b798eb726dfd" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91-4e99294d-0d69-4e00-a0ad-b798eb726dfd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Creating volume 4e99294d-0d69-4e00-a0ad-b798eb726dfd from snapshot 856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] snapshot: 856cf150-3a8c-4741-b3b0-f293e6bd1f91, volume: 4e99294d-0d69-4e00-a0ad-b798eb726dfd, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d008f05-4387-45b7-8b15-f2361f60517d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:32:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:44 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:32:44 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:45 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.818s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7226efd5-b621-4789-ae92-60c604755ccc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:32:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:45 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:32:45 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:46 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.769s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:46 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:32:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:46 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd Jul 08 11:32:46 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:51 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd" returned: 0 in 4.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c78929-31a4-4391-9d61-5e8b18ad1100]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:32:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:51 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:32:51 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:52 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 1.062s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:32:52 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Converted 1024.00 MB image at 212.81 MB/s Jul 08 11:32:52 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd is being set with open permissions: ugo+rw Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:32:52 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd Jul 08 11:32:52 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:52 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:32:52 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:32:53 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd" returned: 0 in 0.879s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" released by "_copy_volume_from_snapshot" :: held 8.446s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:32:53 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91-4e99294d-0d69-4e00-a0ad-b798eb726dfd" released by "_create_volume_from_snapshot" :: held 8.479s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.493s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.870s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfd2eca-cf4b-4b6a-a7cc-d4b4b0402412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd', 'volume_size': 1, 'snapshot_id': '856cf150-3a8c-4741-b3b0-f293e6bd1f91'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bac7ac8-2453-4346-af9a-16507dd7a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:32:53 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Volume volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd (4e99294d-0d69-4e00-a0ad-b798eb726dfd): created successfully Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bac7ac8-2453-4346-af9a-16507dd7a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:32:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Flow 'volume_create_manager' (40552c13-0f9d-4b2e-9c54-6529f4292a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:32:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-62763b9b-11a3-4c25-98d9-41186e91f39f tempest-TestStampPattern-1067233557 None] Created volume successfully. Jul 08 11:33:03 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:33:03 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:33:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:33:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:33:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de2fb9-6927-4427-a7a3-7eb365407ce3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:33:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:33:41 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd Jul 08 11:33:41 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:33:42 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 08 11:33:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd" returned: 0 in 0.749s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:33:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:33:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30', 'name': 'volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95e8e8e1-04eb-4fd2-9215-8115baf7bc7a', 'enforce_multipath': True} {{(pid=86852) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 11:33:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-24399bc1-6941-4688-8971-d5745e80e1cd req-f38e7088-a9ae-4f0b-bb97-3a007b066c88 tempest-TestStampPattern-1067233557 None] attachment_update completed successfully. Jul 08 11:33:48 devstack cinder-volume[86852]: INFO cinder.volume.manager [req-76c9c64e-b0c2-47f9-a2a3-e271a8a638a6 req-15a6d115-af5b-4715-922d-bf6ba7ae6abf tempest-TestStampPattern-1067233557 None] Terminate volume connection completed successfully. Jul 08 11:33:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [req-76c9c64e-b0c2-47f9-a2a3-e271a8a638a6 req-15a6d115-af5b-4715-922d-bf6ba7ae6abf tempest-TestStampPattern-1067233557 None] Deleting attachment 95e8e8e1-04eb-4fd2-9215-8115baf7bc7a. {{(pid=86852) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:33:52 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:33:52 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:33:52 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.659s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:33:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-4e99294d-0d69-4e00-a0ad-b798eb726dfd-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "cinder-4e99294d-0d69-4e00-a0ad-b798eb726dfd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bfa57d-e6ba-46bc-8f99-94eff3bfd9c6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:33:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:33:58 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd Jul 08 11:33:58 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:33:59 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 11:33:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:33:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:33:59 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd Jul 08 11:33:59 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:33:59 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 08 11:33:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4e99294d-0d69-4e00-a0ad-b798eb726dfd" returned: 0 in 0.637s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:33:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-4e99294d-0d69-4e00-a0ad-b798eb726dfd" released by "delete_volume" :: held 1.419s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Created reservations ['eb4bb70c-5525-49c3-91f8-2eb39a07690f', '2b259ed3-b39d-4d29-8b62-7a7631f1614b', '48b39f21-d71f-4ffb-b703-c6ebb36856f9', '3c6a3385-6fdc-42b4-95c1-fd12ad757b56'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:00 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:00 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:00 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Deleted volume successfully. Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f85262f9-80a0-460d-b3e6-5a231cd188a5 tempest-TestStampPattern-1067233557 None] Lock "cinder-4e99294d-0d69-4e00-a0ad-b798eb726dfd-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-856cf150-3a8c-4741-b3b0-f293e6bd1f91-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-856cf150-3a8c-4741-b3b0-f293e6bd1f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Deleting offline snapshot 856cf150-3a8c-4741-b3b0-f293e6bd1f91 of volume 5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] snapshot_file for this snap is: volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab2ef5-d465-45e1-aa11-6cba12014c7d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:01 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:34:01 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:01 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9535f-dfc5-4d6e-a2f2-864e2e7baaaf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:01 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:34:01 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:02 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:02 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:34:02 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:03 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:03 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91 Jul 08 11:34:03 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:03 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0.856cf150-3a8c-4741-b3b0-f293e6bd1f91" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-856cf150-3a8c-4741-b3b0-f293e6bd1f91" released by "_delete_snapshot" :: held 2.938s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" released by "delete_snapshot" :: held 2.960s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:04 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Created reservations ['37b797e2-a036-4fcb-a2cf-1660b13ce1d1', '55e1185b-b31a-4e50-8809-6066a1973889', 'e2406929-d013-42b0-9608-27f58ef596ac', '742a8203-d1db-4207-a463-a5201ff7f822'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Delete snapshot completed successfully. Jul 08 11:34:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-da14b373-55b3-4e6a-b306-4cc6f52f9e56 tempest-TestStampPattern-1067233557 None] Lock "cinder-856cf150-3a8c-4741-b3b0-f293e6bd1f91-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "cinder-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Acquiring lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5b557-e093-4d00-a7c0-399b339c3a3a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:12 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:34:12 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:12 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.747s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:13 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0 Jul 08 11:34:13 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:13 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" returned: 0 in 0.630s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "cinder-quobyte-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0" released by "delete_volume" :: held 1.434s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Created reservations ['359eea29-8d9d-4245-8ee5-8ec9f978fa64', '01f57a39-75bf-4f32-9a81-f2e6940806fc', '59c6701c-6b31-4dd3-9bf5-9153ce6cc8d8', 'bd9c80d6-50a9-4b84-98a8-f2bcf3117140'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:13 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:13 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:14 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Deleted volume successfully. Jul 08 11:34:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ca55f546-3ccd-434e-921f-5aa90dfbb207 tempest-TestStampPattern-1067233557 None] Lock "cinder-5d2c5b05-7ccb-43df-86ac-87a63e52d8e0-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:23 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (92a5dc91-6754-4a73-97e8-d8da4f82789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f1f726-df80-424b-b03b-d3ba7074d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f1f726-df80-424b-b03b-d3ba7074d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1082218353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c667b0d9-52fa-4def-933d-8d98b2878a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:24Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1357fa-96fe-4da4-8619-c1eb35200e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1357fa-96fe-4da4-8619-c1eb35200e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012758e-e3cc-4dba-b828-9666aad1d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012758e-e3cc-4dba-b828-9666aad1d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c667b0d9-52fa-4def-933d-8d98b2878a3e', 'volume_name': 'volume-c667b0d9-52fa-4def-933d-8d98b2878a3e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13e331b-37e2-43c3-b0aa-e9bdcd4c6b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13e331b-37e2-43c3-b0aa-e9bdcd4c6b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bac77a-245d-44fe-abcc-c8988eb02f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Volume c667b0d9-52fa-4def-933d-8d98b2878a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c667b0d9-52fa-4def-933d-8d98b2878a3e', 'volume_size': 1} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1082218353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c667b0d9-52fa-4def-933d-8d98b2878a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:24Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Creating volume c667b0d9-52fa-4def-933d-8d98b2878a3e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:24 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:24 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e 1073741824 Jul 08 11:34:24 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (a82e95ed-3011-43d1-9740-b5c77ee15078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03a2dd9-7882-4896-9d38-9c64a3ac986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03a2dd9-7882-4896-9d38-9c64a3ac986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1291067145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4cb755-d5b4-43e0-afe4-67380a409cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da528b99-8eb5-4110-be1c-8d03414800b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da528b99-8eb5-4110-be1c-8d03414800b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8873b812-c166-47de-818d-7052ad5f085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8873b812-c166-47de-818d-7052ad5f085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4cb755-d5b4-43e0-afe4-67380a409cf4', 'volume_name': 'volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1f69e9-1ce2-4b03-ba63-33fdfd094396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1f69e9-1ce2-4b03-ba63-33fdfd094396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b3fd66-8c58-435d-a916-8df2be4c771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:24 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Volume 8d4cb755-d5b4-43e0-afe4-67380a409cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4', 'volume_size': 1} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (8d96606a-61b8-4bbd-bae7-90e7ae0613e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eb0b3c-922e-4399-944c-334034b4b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eb0b3c-922e-4399-944c-334034b4b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425178757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2402440a-b67c-483f-8841-4188dcdddc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf624a9-1501-4233-adf3-250beb4ba12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf624a9-1501-4233-adf3-250beb4ba12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415fc480-9bd6-4e9b-af64-96af15cace89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415fc480-9bd6-4e9b-af64-96af15cace89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2402440a-b67c-483f-8841-4188dcdddc2d', 'volume_name': 'volume-2402440a-b67c-483f-8841-4188dcdddc2d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a150800a-2b57-4d8c-9252-0beec38c55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a150800a-2b57-4d8c-9252-0beec38c55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c508f-6bdc-4c81-ac8a-2e62e39115fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Volume 2402440a-b67c-483f-8841-4188dcdddc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2402440a-b67c-483f-8841-4188dcdddc2d', 'volume_size': 1} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:25 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e 1073741824" returned: 0 in 0.928s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:25 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e Jul 08 11:34:25 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (0dbe1088-ea3a-4f46-b21b-04d7cf795e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7af893-537c-4be6-ad8d-8f7ca5d871c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7af893-537c-4be6-ad8d-8f7ca5d871c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993554115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b0935b-0205-489e-9ec5-de0c973e0497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e88b553-3139-4dc8-8935-d8bce048a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e88b553-3139-4dc8-8935-d8bce048a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbfcd35-b31f-442c-84f9-3203b266ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbfcd35-b31f-442c-84f9-3203b266ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b0935b-0205-489e-9ec5-de0c973e0497', 'volume_name': 'volume-37b0935b-0205-489e-9ec5-de0c973e0497', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af4d30c-10a8-4a6c-90f1-ead4897a741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af4d30c-10a8-4a6c-90f1-ead4897a741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db347d8f-a00f-485a-a1e3-c30ec5065add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Volume 37b0935b-0205-489e-9ec5-de0c973e0497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b0935b-0205-489e-9ec5-de0c973e0497', 'volume_size': 1} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (ca1d24eb-4b0f-46c9-bac4-381802bc15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553644e3-6086-4946-8594-3dc157d89301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553644e3-6086-4946-8594-3dc157d89301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944749082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3405ac33-136a-47f7-8d32-b87310974ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:26Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc3b814-b8a0-4cf8-bac0-b055391318e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc3b814-b8a0-4cf8-bac0-b055391318e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494de80b-7a08-4493-b72f-16d6039266f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494de80b-7a08-4493-b72f-16d6039266f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3405ac33-136a-47f7-8d32-b87310974ccd', 'volume_name': 'volume-3405ac33-136a-47f7-8d32-b87310974ccd', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5496901-7491-4bd3-bd37-c2c5b36dd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5496901-7491-4bd3-bd37-c2c5b36dd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcb8631-b770-42e3-ab04-447e86fd5c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Volume 3405ac33-136a-47f7-8d32-b87310974ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3405ac33-136a-47f7-8d32-b87310974ccd', 'volume_size': 1} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:25 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e" returned: 0 in 0.662s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1291067145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4cb755-d5b4-43e0-afe4-67380a409cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Creating volume 8d4cb755-d5b4-43e0-afe4-67380a409cf4 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:25 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bac77a-245d-44fe-abcc-c8988eb02f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c667b0d9-52fa-4def-933d-8d98b2878a3e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:26 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 1073741824 Jul 08 11:34:26 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352e9a22-a18b-490a-bb4f-cbc83ad54f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:26 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Volume volume-c667b0d9-52fa-4def-933d-8d98b2878a3e (c667b0d9-52fa-4def-933d-8d98b2878a3e): created successfully Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352e9a22-a18b-490a-bb4f-cbc83ad54f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (92a5dc91-6754-4a73-97e8-d8da4f82789a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7388491e-96de-451f-9ffb-02696c9b2bf4 tempest-CreateVolumesFromImageTest-1826294036 None] Created volume successfully. Jul 08 11:34:26 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 1073741824" returned: 0 in 0.820s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:26 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 Jul 08 11:34:26 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:27 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.411s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-425178757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2402440a-b67c-483f-8841-4188dcdddc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Creating volume 2402440a-b67c-483f-8841-4188dcdddc2d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:27 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b3fd66-8c58-435d-a916-8df2be4c771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:27 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d 1073741824 Jul 08 11:34:27 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1580c888-1de0-455d-8333-646d1cb87b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:27 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Volume volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 (8d4cb755-d5b4-43e0-afe4-67380a409cf4): created successfully Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1580c888-1de0-455d-8333-646d1cb87b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (a82e95ed-3011-43d1-9740-b5c77ee15078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bc314912-3ddd-42fc-8d36-a13f0007aa48 tempest-CreateVolumesFromImageTest-1826294036 None] Created volume successfully. Jul 08 11:34:28 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d 1073741824" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:28 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d Jul 08 11:34:28 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:28 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d" returned: 0 in 0.625s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.547s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993554115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b0935b-0205-489e-9ec5-de0c973e0497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:25Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Creating volume 37b0935b-0205-489e-9ec5-de0c973e0497 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:28 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:28 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 1073741824 Jul 08 11:34:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c508f-6bdc-4c81-ac8a-2e62e39115fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2402440a-b67c-483f-8841-4188dcdddc2d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:28 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c6e023-2779-4995-a945-9835b12298a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Volume volume-2402440a-b67c-483f-8841-4188dcdddc2d (2402440a-b67c-483f-8841-4188dcdddc2d): created successfully Jul 08 11:34:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c6e023-2779-4995-a945-9835b12298a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (8d96606a-61b8-4bbd-bae7-90e7ae0613e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4035e0b1-7a5b-47d1-815d-e91affb8f773 tempest-CreateVolumesFromImageTest-1826294036 None] Created volume successfully. Jul 08 11:34:29 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 1073741824" returned: 0 in 0.799s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:29 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 Jul 08 11:34:29 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:30 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.709s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944749082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3405ac33-136a-47f7-8d32-b87310974ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bbd672925b4d13bfd24f9527c0a113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:26Z,use_quota=True,user_id='238fedabd30a42fb84c0395fe093322a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Creating volume 3405ac33-136a-47f7-8d32-b87310974ccd {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:30 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db347d8f-a00f-485a-a1e3-c30ec5065add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b0935b-0205-489e-9ec5-de0c973e0497', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:30 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd 1073741824 Jul 08 11:34:30 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19402da3-b7de-4a2e-b5f2-e74a6c56cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:30 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Volume volume-37b0935b-0205-489e-9ec5-de0c973e0497 (37b0935b-0205-489e-9ec5-de0c973e0497): created successfully Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19402da3-b7de-4a2e-b5f2-e74a6c56cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:30 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (0dbe1088-ea3a-4f46-b21b-04d7cf795e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:30 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-eacb4aec-54b6-4c7b-a2b2-102fa3edbd65 tempest-CreateVolumesFromImageTest-1826294036 None] Created volume successfully. Jul 08 11:34:31 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd 1073741824" returned: 0 in 0.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:31 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd Jul 08 11:34:31 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:31 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcb8631-b770-42e3-ab04-447e86fd5c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3405ac33-136a-47f7-8d32-b87310974ccd', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68984313-c444-45bc-90c1-7da0ee44c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Volume volume-3405ac33-136a-47f7-8d32-b87310974ccd (3405ac33-136a-47f7-8d32-b87310974ccd): created successfully Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68984313-c444-45bc-90c1-7da0ee44c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Flow 'volume_create_manager' (ca1d24eb-4b0f-46c9-bac4-381802bc15f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1f4edf9e-af4d-43dc-a7d8-0569a5b269f2 tempest-CreateVolumesFromImageTest-1826294036 None] Created volume successfully. Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-3405ac33-136a-47f7-8d32-b87310974ccd-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-3405ac33-136a-47f7-8d32-b87310974ccd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-quobyte-3405ac33-136a-47f7-8d32-b87310974ccd" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-3405ac33-136a-47f7-8d32-b87310974ccd" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a105ef-f82a-4d76-bf6a-1a5b45aed3d8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:32 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd Jul 08 11:34:32 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:33 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:33 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd Jul 08 11:34:33 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:33 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3405ac33-136a-47f7-8d32-b87310974ccd" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-3405ac33-136a-47f7-8d32-b87310974ccd" released by "delete_volume" :: held 1.444s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=34,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Created reservations ['af00e616-8c06-44de-a725-96efd81ab5b3', '212e0e27-3892-4dda-ba0e-c05bce2912f8', '19c3fbb2-fe51-4b56-b250-a65c5ca0375c', '74cf549d-4b70-4cc1-90f6-32b71c1b56f0'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:33 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:33 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-37b0935b-0205-489e-9ec5-de0c973e0497-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-37b0935b-0205-489e-9ec5-de0c973e0497-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-quobyte-37b0935b-0205-489e-9ec5-de0c973e0497" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-37b0935b-0205-489e-9ec5-de0c973e0497" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:34 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:34 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Deleted volume successfully. Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d2f97-98ba-4441-8d8b-e8a7bb522361]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-741beb3e-10c9-4c85-b535-9f75f44f2c99 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-3405ac33-136a-47f7-8d32-b87310974ccd-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:34 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 Jul 08 11:34:34 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:35 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497" returned: 0 in 0.742s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:35 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497 Jul 08 11:34:35 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:35 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-37b0935b-0205-489e-9ec5-de0c973e0497" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-37b0935b-0205-489e-9ec5-de0c973e0497" released by "delete_volume" :: held 1.431s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Created reservations ['39c9d976-6f03-410d-a38f-f61cbecbc6b6', '7ae7d05a-cc0c-4b3c-91ff-c498d8fa7117', '13cd4357-6881-4970-bbaa-e163e57063f5', 'c207b1e9-f3b1-4e0f-9ccc-7da8d21f2404'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:36 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:36 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-2402440a-b67c-483f-8841-4188dcdddc2d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:36 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.628s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Deleted volume successfully. Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-2402440a-b67c-483f-8841-4188dcdddc2d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0cf5427e-6738-43ef-9f02-281869639f16 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-37b0935b-0205-489e-9ec5-de0c973e0497-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-quobyte-2402440a-b67c-483f-8841-4188dcdddc2d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-2402440a-b67c-483f-8841-4188dcdddc2d" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32eab8-ceae-47a0-903a-711c8c9ff476]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:36 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d Jul 08 11:34:36 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:37 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d" returned: 0 in 0.759s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:37 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d Jul 08 11:34:37 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:38 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2402440a-b67c-483f-8841-4188dcdddc2d" returned: 0 in 0.640s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-2402440a-b67c-483f-8841-4188dcdddc2d" released by "delete_volume" :: held 1.439s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Created reservations ['dcbb34fc-81a6-4f52-8b9f-38020d94506e', '67f5c8ac-b552-4017-9cd8-f9a708a1a038', '464d736a-c926-4fcc-92e6-3553f00a930a', '5d0d564d-70ac-4d0e-aebc-e13c05cb58c9'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:38 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:38 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-8d4cb755-d5b4-43e0-afe4-67380a409cf4-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-8d4cb755-d5b4-43e0-afe4-67380a409cf4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-quobyte-8d4cb755-d5b4-43e0-afe4-67380a409cf4" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:38 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:38 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Deleted volume successfully. Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-8d4cb755-d5b4-43e0-afe4-67380a409cf4" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f0b8c-3162-4874-aeca-f5f5f1cb46e4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-db1294b8-dcb5-4a64-a047-04e7e1ffa783 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-2402440a-b67c-483f-8841-4188dcdddc2d-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:39 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 Jul 08 11:34:39 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:39 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4" returned: 0 in 0.744s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:39 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4 Jul 08 11:34:39 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:40 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8d4cb755-d5b4-43e0-afe4-67380a409cf4" returned: 0 in 0.627s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-8d4cb755-d5b4-43e0-afe4-67380a409cf4" released by "delete_volume" :: held 1.411s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Created reservations ['5d43b5ef-02a4-4805-aea5-97a659a52511', '495bde7d-21ed-4cd3-b164-adf7f20861dd', '4b1d8ce7-22d8-43bf-8f07-b082dd54623a', 'c83803c7-aaa2-403d-8eb2-ff2ae5156bef'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:40 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:40 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-c667b0d9-52fa-4def-933d-8d98b2878a3e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:41 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.638s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Deleted volume successfully. Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-c667b0d9-52fa-4def-933d-8d98b2878a3e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d5b8b06e-f371-4640-babf-0b170fe0af1a tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-8d4cb755-d5b4-43e0-afe4-67380a409cf4-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "cinder-quobyte-c667b0d9-52fa-4def-933d-8d98b2878a3e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-c667b0d9-52fa-4def-933d-8d98b2878a3e" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe1b04-b0f1-4359-9425-42b7a80bd991]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:41 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e Jul 08 11:34:41 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:41 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e" returned: 0 in 0.741s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:41 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e Jul 08 11:34:41 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:42 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c667b0d9-52fa-4def-933d-8d98b2878a3e" returned: 0 in 0.648s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-quobyte-c667b0d9-52fa-4def-933d-8d98b2878a3e" released by "delete_volume" :: held 1.425s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Created reservations ['5b630719-49f4-4caa-adfa-98e1bd38a384', '8c53675e-499e-4bfb-b8f5-8482740a3e43', '030fb984-c577-4935-9b69-f8c3f69a1690', '75481d03-9212-44fa-8076-7ab5c1c83312'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:42 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:42 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:43 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:43 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:43 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Deleted volume successfully. Jul 08 11:34:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02122ca5-deec-4f74-935a-b87769348552 tempest-CreateVolumesFromImageTest-1826294036 None] Lock "cinder-c667b0d9-52fa-4def-933d-8d98b2878a3e-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:34:47 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Flow 'volume_create_manager' (ee9ab1c6-84db-4865-93f2-12aacbca9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c093aaf-adac-4f0c-bd74-d50e98fb6242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c093aaf-adac-4f0c-bd74-d50e98fb6242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eadf904-d0ff-40d5-863a-1ce877436152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633c4b9c5994af288f57b414e5df2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:48Z,use_quota=True,user_id='ba43b9f91cc14f5788bd6ab60a86aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfa3df7-6973-4570-a1ab-dc5b55d29247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfa3df7-6973-4570-a1ab-dc5b55d29247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af3fdb2-6d97-487f-b8b1-f7922314bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af3fdb2-6d97-487f-b8b1-f7922314bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1eadf904-d0ff-40d5-863a-1ce877436152', 'volume_name': 'volume-1eadf904-d0ff-40d5-863a-1ce877436152', 'volume_size': 1, 'image_id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73248bc3985be642fb29172dc669f27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9633c4b9c5994af288f57b414e5df2de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfb31015fa56d9c4c314d69549a308e3ed2b5dd609fa398c966b730e083726632b6aa5be57f03ce301c7a5248a2883362b8c1c6ae6082e0e8c946b63a2fb2dfb', 'id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'created_at': datetime.datetime(2026, 7, 8, 9, 34, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a147df8a-9d9d-4a82-9564-92d329cad6ff/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27f75a-9655-4f62-a7f8-a460bc0bc1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c27f75a-9655-4f62-a7f8-a460bc0bc1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a74be-9df2-4222-9bda-8841dd0ad186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:48 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Volume 1eadf904-d0ff-40d5-863a-1ce877436152: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1eadf904-d0ff-40d5-863a-1ce877436152', 'volume_size': 1, 'image_id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73248bc3985be642fb29172dc669f27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9633c4b9c5994af288f57b414e5df2de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfb31015fa56d9c4c314d69549a308e3ed2b5dd609fa398c966b730e083726632b6aa5be57f03ce301c7a5248a2883362b8c1c6ae6082e0e8c946b63a2fb2dfb', 'id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'created_at': datetime.datetime(2026, 7, 8, 9, 34, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a147df8a-9d9d-4a82-9564-92d329cad6ff/file', 'properties': {}}, 'image_service': } Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Trying to clone 1eadf904-d0ff-40d5-863a-1ce877436152 from image a147df8a-9d9d-4a82-9564-92d329cad6ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:34:48 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35b456-b8ae-4bc1-bb4d-36f62612d01c]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:48 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:48 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:49 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:49 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:49 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 1 in 0.708s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Temporary image a147df8a-9d9d-4a82-9564-92d329cad6ff is fetched for user ba43b9f91cc14f5788bd6ab60a86aeb1. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fedd215-92eb-4ee4-8291-774aff543273]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:50 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:50 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:50 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:50 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:50 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:51 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 1 in 0.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eadf904-d0ff-40d5-863a-1ce877436152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9633c4b9c5994af288f57b414e5df2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:34:48Z,use_quota=True,user_id='ba43b9f91cc14f5788bd6ab60a86aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Creating volume 1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:34:51 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:34:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:51 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1073741824 Jul 08 11:34:51 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:52 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1073741824" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:52 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:34:52 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:52 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:34:52 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:52 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Attempting download of a147df8a-9d9d-4a82-9564-92d329cad6ff ((None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}])) to volume 1eadf904-d0ff-40d5-863a-1ce877436152. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:34:52 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.645s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fa088-12ff-46bd-b10e-087ed7bb151f]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:53 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb Jul 08 11:34:53 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:53 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:53 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb Jul 08 11:34:53 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:54 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb" returned: 1 in 0.721s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a147df8a-9d9d-4a82-9564-92d329cad6ff_nlmalevb' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:34:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c98eab-afce-45a0-8e75-22244d0f4b61]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:54 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:54 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:55 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:55 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD Jul 08 11:34:55 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:55 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD" returned: 1 in 0.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] a147df8a-9d9d-4a82-9564-92d329cad6ff was raw, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:34:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:55 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:34:55 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:56 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 0 in 0.715s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:56 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a147df8a-9d9d-4a82-9564-92d329cad6ff_loxfoog5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:34:56 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:34:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:56 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1G Jul 08 11:34:56 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:57 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 1G" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[37352871-4324-4092-adf8-309dea95c583]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:57 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:34:57 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:57 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 0 in 0.742s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:58 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:34:58 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:34:58 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 1 in 0.747s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Downloaded image a147df8a-9d9d-4a82-9564-92d329cad6ff ((None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}])) to volume 1eadf904-d0ff-40d5-863a-1ce877436152 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Temporary image a147df8a-9d9d-4a82-9564-92d329cad6ff for user ba43b9f91cc14f5788bd6ab60a86aeb1 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Marking volume 1eadf904-d0ff-40d5-863a-1ce877436152 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Copying metadata from image a147df8a-9d9d-4a82-9564-92d329cad6ff to 1eadf904-d0ff-40d5-863a-1ce877436152. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Creating volume glance metadata for volume 1eadf904-d0ff-40d5-863a-1ce877436152 backed by image a147df8a-9d9d-4a82-9564-92d329cad6ff with: {'image_id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '73248bc3985be642fb29172dc669f27e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a74be-9df2-4222-9bda-8841dd0ad186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eadf904-d0ff-40d5-863a-1ce877436152', 'volume_size': 1, 'image_id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a147df8a-9d9d-4a82-9564-92d329cad6ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73248bc3985be642fb29172dc669f27e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9633c4b9c5994af288f57b414e5df2de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfb31015fa56d9c4c314d69549a308e3ed2b5dd609fa398c966b730e083726632b6aa5be57f03ce301c7a5248a2883362b8c1c6ae6082e0e8c946b63a2fb2dfb', 'id': 'a147df8a-9d9d-4a82-9564-92d329cad6ff', 'created_at': datetime.datetime(2026, 7, 8, 9, 34, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a147df8a-9d9d-4a82-9564-92d329cad6ff/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996fe968-8928-4bd2-8efd-d86c372c1dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:34:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Volume volume-1eadf904-d0ff-40d5-863a-1ce877436152 (1eadf904-d0ff-40d5-863a-1ce877436152): created successfully Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996fe968-8928-4bd2-8efd-d86c372c1dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:34:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Flow 'volume_create_manager' (ee9ab1c6-84db-4865-93f2-12aacbca9878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:34:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fc05e689-f7fa-4159-ae70-b7a259a22356 tempest-VolumeImageDependencyTests-1168679790 None] Created volume successfully. Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Acquiring lock "cinder-1eadf904-d0ff-40d5-863a-1ce877436152-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "cinder-1eadf904-d0ff-40d5-863a-1ce877436152-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Acquiring lock "cinder-quobyte-1eadf904-d0ff-40d5-863a-1ce877436152" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "cinder-quobyte-1eadf904-d0ff-40d5-863a-1ce877436152" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e0b73-9add-4141-bca7-7496d19c699a]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:34:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:34:59 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:34:59 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:00 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:00 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:35:00 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:01 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 1 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:01 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152 Jul 08 11:35:01 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:01 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-1eadf904-d0ff-40d5-863a-1ce877436152" returned: 0 in 0.634s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "cinder-quobyte-1eadf904-d0ff-40d5-863a-1ce877436152" released by "delete_volume" :: held 2.146s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Created reservations ['c12bd880-ab49-456b-89bf-bbbba4fd00bd', '7b826273-91b6-4ff9-a992-d5b0a1cab814', 'cc761d9a-8262-4ff5-91a4-7bee83105be4', '835e50fe-9eed-46a7-8a21-fce0f0905a68'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:01 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:01 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:02 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.628s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Deleted volume successfully. Jul 08 11:35:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2009a6fc-a66a-47cb-9bb0-efce74bb480b tempest-VolumeImageDependencyTests-1168679790 None] Lock "cinder-1eadf904-d0ff-40d5-863a-1ce877436152-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (d4239e0f-fbc0-41c4-b41f-7e6abab5020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8849bcda-2058-4765-a53b-706718ecec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8849bcda-2058-4765-a53b-706718ecec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543277419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96baad-5ef9-42ff-8dc8-728d1532fb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:10Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcae807d-a25f-4bf0-a4cc-7f8b8825bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcae807d-a25f-4bf0-a4cc-7f8b8825bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff7deee-6123-45cb-8059-b780b56b8eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff7deee-6123-45cb-8059-b780b56b8eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b96baad-5ef9-42ff-8dc8-728d1532fb9e', 'volume_name': 'volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb69991-debf-4448-abb0-c68304889468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb69991-debf-4448-abb0-c68304889468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3356e60b-b589-4a48-b2e8-6191df03a832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Volume 5b96baad-5ef9-42ff-8dc8-728d1532fb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e', 'volume_size': 1} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543277419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b96baad-5ef9-42ff-8dc8-728d1532fb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:10Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Creating volume 5b96baad-5ef9-42ff-8dc8-728d1532fb9e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:10 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:10 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e 1073741824 Jul 08 11:35:10 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:11 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e 1073741824" returned: 0 in 0.794s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:11 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e Jul 08 11:35:11 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:11 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" returned: 0 in 0.642s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3356e60b-b589-4a48-b2e8-6191df03a832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873b50db-304b-49ec-937d-21d226f1f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:11 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Volume volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e (5b96baad-5ef9-42ff-8dc8-728d1532fb9e): created successfully Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873b50db-304b-49ec-937d-21d226f1f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:11 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (d4239e0f-fbc0-41c4-b41f-7e6abab5020d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-814cdb82-e48a-48ef-b02c-541ccf96b4d9 tempest-ProjectReaderTests-1272113135 None] Created volume successfully. Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-5b96baad-5ef9-42ff-8dc8-728d1532fb9e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-5b96baad-5ef9-42ff-8dc8-728d1532fb9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-quobyte-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" acquired by "delete_volume" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6635e-cc92-40e0-b8e5-d31fb03ec4c0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:12 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e Jul 08 11:35:12 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:13 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" returned: 0 in 0.753s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:13 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e Jul 08 11:35:13 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:14 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" returned: 0 in 0.635s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-5b96baad-5ef9-42ff-8dc8-728d1532fb9e" released by "delete_volume" :: held 1.425s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Created reservations ['bc374d95-3847-431b-b386-b4e63d1282d4', 'b02db917-c289-4096-98ff-c7c51922b841', 'b6eddb74-6bfc-4d57-8522-a9c55ad8fd78', '9ed6af33-b943-48f8-890c-98b72faa828c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:14 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:14 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:14 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Deleted volume successfully. Jul 08 11:35:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b9d856f-a000-4516-b4c8-7cfbd9fdabb2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-5b96baad-5ef9-42ff-8dc8-728d1532fb9e-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (87083591-8f83-44f4-84da-e3470b182faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792e41d5-d7a5-474e-b55f-9b6f49bcda20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792e41d5-d7a5-474e-b55f-9b6f49bcda20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752966797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0146ccd0-63f0-4e39-9845-7211c028a857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:15Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d767a-0530-4598-8ae4-55fc67ad0abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20d767a-0530-4598-8ae4-55fc67ad0abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13436ed1-0d91-475e-b37f-27d89b007567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13436ed1-0d91-475e-b37f-27d89b007567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0146ccd0-63f0-4e39-9845-7211c028a857', 'volume_name': 'volume-0146ccd0-63f0-4e39-9845-7211c028a857', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bccd3a2-0417-4a80-8742-6094a0ed4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bccd3a2-0417-4a80-8742-6094a0ed4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c04b4bd-c614-4ca5-9d0d-6061daaac853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Volume 0146ccd0-63f0-4e39-9845-7211c028a857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0146ccd0-63f0-4e39-9845-7211c028a857', 'volume_size': 1} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-752966797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0146ccd0-63f0-4e39-9845-7211c028a857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:15Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Creating volume 0146ccd0-63f0-4e39-9845-7211c028a857 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:15 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:15 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 1073741824 Jul 08 11:35:15 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:16 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 1073741824" returned: 0 in 0.798s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:16 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 Jul 08 11:35:16 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:16 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857" returned: 0 in 0.628s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c04b4bd-c614-4ca5-9d0d-6061daaac853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0146ccd0-63f0-4e39-9845-7211c028a857', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d039419-59fe-4056-9a98-a08f00bcffb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Volume volume-0146ccd0-63f0-4e39-9845-7211c028a857 (0146ccd0-63f0-4e39-9845-7211c028a857): created successfully Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d039419-59fe-4056-9a98-a08f00bcffb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (87083591-8f83-44f4-84da-e3470b182faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f7d6b153-ad9d-4094-a942-d0ac60cd1d19 tempest-ProjectReaderTests-1272113135 None] Created volume successfully. Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-0146ccd0-63f0-4e39-9845-7211c028a857-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-0146ccd0-63f0-4e39-9845-7211c028a857-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-quobyte-0146ccd0-63f0-4e39-9845-7211c028a857" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-0146ccd0-63f0-4e39-9845-7211c028a857" acquired by "delete_volume" :: waited 0.012s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d64fe6-8769-492d-bf69-89def177c4f8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:17 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 Jul 08 11:35:17 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:18 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857" returned: 0 in 0.746s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:18 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857 Jul 08 11:35:18 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:18 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0146ccd0-63f0-4e39-9845-7211c028a857" returned: 0 in 0.634s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-0146ccd0-63f0-4e39-9845-7211c028a857" released by "delete_volume" :: held 1.419s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Created reservations ['38a433f1-b7f0-46ce-a591-4a1ce5357d36', 'fef9dacc-c7a0-467a-ba80-76cddc3ca2d5', '621e8921-a1a5-49fb-8a6d-b4ac9cb0d4c0', 'b0bf3652-3bb1-4de2-96b7-c0b8d41e4222'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:18 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:18 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:19 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Deleted volume successfully. Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-61b32059-1908-4d01-b1fd-05bbb7dd07e2 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-0146ccd0-63f0-4e39-9845-7211c028a857-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (3e5731ac-55b5-460e-b4ae-6a9d9c86bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72107a4c-cc11-4abd-98a8-6d0eb0cbd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72107a4c-cc11-4abd-98a8-6d0eb0cbd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264179551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47061f01-2cb9-4606-912e-f0fc31cd07c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:20Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473ee9a-157e-4421-b907-03e539fd0058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d473ee9a-157e-4421-b907-03e539fd0058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165125a8-9afd-4eea-be2e-8c8bf68af325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165125a8-9afd-4eea-be2e-8c8bf68af325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47061f01-2cb9-4606-912e-f0fc31cd07c4', 'volume_name': 'volume-47061f01-2cb9-4606-912e-f0fc31cd07c4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e77489-8a27-42e2-95eb-e820b98ce409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e77489-8a27-42e2-95eb-e820b98ce409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda9f089-2577-48fd-a62a-e79a489eec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Volume 47061f01-2cb9-4606-912e-f0fc31cd07c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47061f01-2cb9-4606-912e-f0fc31cd07c4', 'volume_size': 1} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264179551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47061f01-2cb9-4606-912e-f0fc31cd07c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:20Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Creating volume 47061f01-2cb9-4606-912e-f0fc31cd07c4 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:20 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:20 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 1073741824 Jul 08 11:35:20 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:20 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 1073741824" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:20 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 Jul 08 11:35:20 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:21 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4" returned: 0 in 0.652s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda9f089-2577-48fd-a62a-e79a489eec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47061f01-2cb9-4606-912e-f0fc31cd07c4', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bde4df-1254-41e0-8e4c-db0bed03d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Volume volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 (47061f01-2cb9-4606-912e-f0fc31cd07c4): created successfully Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69bde4df-1254-41e0-8e4c-db0bed03d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (3e5731ac-55b5-460e-b4ae-6a9d9c86bff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d9866cf4-17bc-4b69-92c9-1fb82efda049 tempest-ProjectReaderTests-1272113135 None] Created volume successfully. Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-47061f01-2cb9-4606-912e-f0fc31cd07c4-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-47061f01-2cb9-4606-912e-f0fc31cd07c4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-quobyte-47061f01-2cb9-4606-912e-f0fc31cd07c4" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-47061f01-2cb9-4606-912e-f0fc31cd07c4" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089c2ec-b087-49bd-9d60-dcad4fa93db3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:22 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 Jul 08 11:35:22 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:22 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4" returned: 0 in 0.751s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:22 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4 Jul 08 11:35:22 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:23 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-47061f01-2cb9-4606-912e-f0fc31cd07c4" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-47061f01-2cb9-4606-912e-f0fc31cd07c4" released by "delete_volume" :: held 1.456s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Created reservations ['e9af3308-2e65-4b8d-b6f5-677be58cc6e0', 'cbc6d057-b354-4909-bf47-2b7f15ed8b62', '573205fb-2cae-447b-91a5-afc99a3afa3d', '6bc373de-83bb-4ff2-a2c3-d79bb0355147'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:23 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:23 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:24 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Deleted volume successfully. Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4540669f-03fd-403e-abc6-55f8c1b37d23 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-47061f01-2cb9-4606-912e-f0fc31cd07c4-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=69,cinder:UPDATE=107,cinder:DELETE=8,cinder:INSERT=25 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (4df90187-f8a8-4f67-ab66-0c19b54f6d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96690429-7a4c-4f60-b7d8-1a426195be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96690429-7a4c-4f60-b7d8-1a426195be1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363709065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfecf6f8-d559-4ebf-b39d-eebfcf176514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:25Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ab553-8eb2-4abb-8896-ab24f2a335ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ab553-8eb2-4abb-8896-ab24f2a335ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6ee5de-0f96-4123-a515-4a4cb15e1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6ee5de-0f96-4123-a515-4a4cb15e1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfecf6f8-d559-4ebf-b39d-eebfcf176514', 'volume_name': 'volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9531a646-9ca6-4602-88ee-03dc66e06c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9531a646-9ca6-4602-88ee-03dc66e06c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6e7f8c-a96e-4df3-ad1c-f760f62dedca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:24 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Volume cfecf6f8-d559-4ebf-b39d-eebfcf176514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514', 'volume_size': 1} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363709065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfecf6f8-d559-4ebf-b39d-eebfcf176514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df11185336b04f859d62daeb1c8a4fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:25Z,use_quota=True,user_id='eaf39815ba7a4fcda86b8f35c2717fd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Creating volume cfecf6f8-d559-4ebf-b39d-eebfcf176514 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:24 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:24 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 1073741824 Jul 08 11:35:24 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:25 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 1073741824" returned: 0 in 0.803s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:25 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 Jul 08 11:35:25 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:26 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6e7f8c-a96e-4df3-ad1c-f760f62dedca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d79f34-e838-4546-bc55-263282dbd72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:26 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Volume volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 (cfecf6f8-d559-4ebf-b39d-eebfcf176514): created successfully Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d79f34-e838-4546-bc55-263282dbd72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Flow 'volume_create_manager' (4df90187-f8a8-4f67-ab66-0c19b54f6d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-58cb1973-79a1-49d7-a4ba-63c1eaf95ef8 tempest-ProjectReaderTests-1272113135 None] Created volume successfully. Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-cfecf6f8-d559-4ebf-b39d-eebfcf176514-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-cfecf6f8-d559-4ebf-b39d-eebfcf176514-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "cinder-quobyte-cfecf6f8-d559-4ebf-b39d-eebfcf176514" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-cfecf6f8-d559-4ebf-b39d-eebfcf176514" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc407cea-1c7d-40c8-9dd6-d8c2b658a925]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:26 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 Jul 08 11:35:26 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:27 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:27 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514 Jul 08 11:35:27 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:28 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cfecf6f8-d559-4ebf-b39d-eebfcf176514" returned: 0 in 0.629s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-quobyte-cfecf6f8-d559-4ebf-b39d-eebfcf176514" released by "delete_volume" :: held 1.410s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Created reservations ['684ecfd9-0208-4f15-b882-96392af992b4', 'fe9838ae-6aae-4fca-90be-3a17a39936b5', 'b4d30eb4-59e4-4529-87b1-a593a947b849', '8fe4bea1-d9fb-47a3-adae-e12a27a0621e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:28 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:28 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:29 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.643s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:29 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Deleted volume successfully. Jul 08 11:35:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2fef2222-7516-4f25-9c49-61506900cb97 tempest-ProjectReaderTests-1272113135 None] Lock "cinder-cfecf6f8-d559-4ebf-b39d-eebfcf176514-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:35:38 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:35:39 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:INSERT=31,cinder:UPDATE=94,cinder:SELECT=65,cinder:DELETE=8 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (71bfbe49-a6b8-4151-a341-c17f47dd9b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d58a34-106e-4b74-8480-1dfe25b56057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d58a34-106e-4b74-8480-1dfe25b56057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959687012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef83d87c-aed3-4ed5-9b61-91921e137e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:41Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21ca50-b49d-4f8a-b4c2-a1af82f9848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c21ca50-b49d-4f8a-b4c2-a1af82f9848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48628de9-93d0-4a5d-bd63-c9c7593b38f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48628de9-93d0-4a5d-bd63-c9c7593b38f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef83d87c-aed3-4ed5-9b61-91921e137e1e', 'volume_name': 'volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cbea9d-d17b-469d-8006-8480a5a0d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cbea9d-d17b-469d-8006-8480a5a0d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bb00ae-d31d-40b0-9e3a-7adc9b088b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume ef83d87c-aed3-4ed5-9b61-91921e137e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e', 'volume_size': 1} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959687012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef83d87c-aed3-4ed5-9b61-91921e137e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:41Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:41 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:41 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e 1073741824 Jul 08 11:35:41 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (e6eff07d-5540-4c37-bf77-f384043c70c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c589828e-dd64-490b-a508-6a0c5c3fc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c589828e-dd64-490b-a508-6a0c5c3fc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581731868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c981ec59-4527-46fc-9553-4b8fd54844ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:41Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fc6ea1-7582-4c93-8c18-7906acaefd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fc6ea1-7582-4c93-8c18-7906acaefd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84c94fd-ca85-40eb-a5a9-7f211d580948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84c94fd-ca85-40eb-a5a9-7f211d580948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c981ec59-4527-46fc-9553-4b8fd54844ed', 'volume_name': 'volume-c981ec59-4527-46fc-9553-4b8fd54844ed', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1311774c-ae09-407c-976d-0e3aafaae86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1311774c-ae09-407c-976d-0e3aafaae86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b68eca-7d5b-49ea-82fa-bb5c7910dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume c981ec59-4527-46fc-9553-4b8fd54844ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c981ec59-4527-46fc-9553-4b8fd54844ed', 'volume_size': 1} Jul 08 11:35:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:42 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e 1073741824" returned: 0 in 0.949s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:42 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e Jul 08 11:35:42 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:42 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e" returned: 0 in 0.695s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581731868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c981ec59-4527-46fc-9553-4b8fd54844ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:41Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume c981ec59-4527-46fc-9553-4b8fd54844ed {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:42 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bb00ae-d31d-40b0-9e3a-7adc9b088b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:42 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed 1073741824 Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb8ef8c-925d-407e-b46a-dea2f234b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:42 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:42 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e (ef83d87c-aed3-4ed5-9b61-91921e137e1e): created successfully Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb8ef8c-925d-407e-b46a-dea2f234b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (71bfbe49-a6b8-4151-a341-c17f47dd9b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-27e9fc31-7ab7-4f6e-a9ec-f83d9ad512cd tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Flow 'volume_create_manager' (d8f39992-bde2-4514-b773-cb3e21dcfe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add776fc-8419-410e-97ac-ee85ecf3b254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add776fc-8419-410e-97ac-ee85ecf3b254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd30334-dc47-46a3-945e-ddf11e918ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e98e2e18f1d48d58a8fc75ac820b508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:44Z,use_quota=True,user_id='4660f82e44ca428ea6f2e52ed849b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503c7aa4-b69c-48ea-a71c-a3b0b519df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503c7aa4-b69c-48ea-a71c-a3b0b519df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab7b9c0-72c4-4278-ae04-543ca333f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:35:43 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed 1073741824" returned: 0 in 0.975s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:43 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed Jul 08 11:35:43 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab7b9c0-72c4-4278-ae04-543ca333f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efd30334-dc47-46a3-945e-ddf11e918ef2', 'volume_name': 'volume-efd30334-dc47-46a3-945e-ddf11e918ef2', 'volume_size': 1, 'image_id': 'cf17d0da-9230-4790-9c41-218d07381728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb8de153a1eff4633ce6706863a3ce2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e98e2e18f1d48d58a8fc75ac820b508', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d11a27ce46ed2b57fbdb6d572f29250a9967911b93336b733e35de2d81cc945abe5981c2932582093caab0198bd7c93f4adf08f9ad950bdf071a3ef2dc0979', 'id': 'cf17d0da-9230-4790-9c41-218d07381728', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf17d0da-9230-4790-9c41-218d07381728/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c5eaaa-ad68-447b-8f81-2ab41739ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c5eaaa-ad68-447b-8f81-2ab41739ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4539f4b7-c88a-43fd-a9b5-ef15f410dd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Volume efd30334-dc47-46a3-945e-ddf11e918ef2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efd30334-dc47-46a3-945e-ddf11e918ef2', 'volume_size': 1, 'image_id': 'cf17d0da-9230-4790-9c41-218d07381728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb8de153a1eff4633ce6706863a3ce2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e98e2e18f1d48d58a8fc75ac820b508', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d11a27ce46ed2b57fbdb6d572f29250a9967911b93336b733e35de2d81cc945abe5981c2932582093caab0198bd7c93f4adf08f9ad950bdf071a3ef2dc0979', 'id': 'cf17d0da-9230-4790-9c41-218d07381728', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf17d0da-9230-4790-9c41-218d07381728/file', 'properties': {}}, 'image_service': } Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Trying to clone efd30334-dc47-46a3-945e-ddf11e918ef2 from image cf17d0da-9230-4790-9c41-218d07381728 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:35:44 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a36563c-c03f-4b8a-8177-45dee21dc1b8]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:44 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:35:44 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:44 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed" returned: 0 in 0.712s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.248s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating offline snapshot e73277d5-017a-4246-ba7d-367cb1e7ca97 of volume ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b68eca-7d5b-49ea-82fa-bb5c7910dda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c981ec59-4527-46fc-9553-4b8fd54844ed', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee51203-3e53-4725-a084-a47b683a38a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2196cecb-7cef-4495-a762-6b5f001c1007]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-c981ec59-4527-46fc-9553-4b8fd54844ed (c981ec59-4527-46fc-9553-4b8fd54844ed): created successfully Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee51203-3e53-4725-a084-a47b683a38a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (e6eff07d-5540-4c37-bf77-f384043c70c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-31f4120c-9c4b-4d7e-b765-4c1bb2961f51 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:44 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e Jul 08 11:35:44 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Flow 'volume_create_manager' (7321f172-5297-4eeb-9dd3-74e0eecabd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c157384-16c2-4f75-b97e-fe5c5d62378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c157384-16c2-4f75-b97e-fe5c5d62378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d57789-e20c-4348-aef7-bae89f6437e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7418456c176f4b269a18583406fb50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:45Z,use_quota=True,user_id='0de942f0c09d4eb585b8132624787c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc1f4a-9b87-47da-899f-571bc96cc097),volume_type_id=b0fc1f4a-9b87-47da-899f-571bc96cc097)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218ccf19-88d0-40a8-a35f-619182ee07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218ccf19-88d0-40a8-a35f-619182ee07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e1595-fae4-404a-a7cd-63e759be4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:44 devstack cinder-volume[86852]: DEBUG cinder.image.glance [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Creating Keystone auth plugin from conf {{(pid=86852) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e1595-fae4-404a-a7cd-63e759be4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60d57789-e20c-4348-aef7-bae89f6437e9', 'volume_name': 'volume-60d57789-e20c-4348-aef7-bae89f6437e9', 'volume_size': 1, 'image_id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb72394c9fdec669bfdf236d5d42f493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7418456c176f4b269a18583406fb50a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ead7fc7ab96397ed3aac753f8765350db8b92ca01ccfb3bddb36b621c808ec66b9b3f1de75675aabd5bafce81acba311153bea7d7905d11d9283f279470b545b', 'id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b3a659c-b67e-4237-9cd6-556467ee5723/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36131c96-8bf1-4e35-becf-42fe13c1fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36131c96-8bf1-4e35-becf-42fe13c1fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c290d-ed7d-4b0a-b505-b211d4897653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:45 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Volume 60d57789-e20c-4348-aef7-bae89f6437e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60d57789-e20c-4348-aef7-bae89f6437e9', 'volume_size': 1, 'image_id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb72394c9fdec669bfdf236d5d42f493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7418456c176f4b269a18583406fb50a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ead7fc7ab96397ed3aac753f8765350db8b92ca01ccfb3bddb36b621c808ec66b9b3f1de75675aabd5bafce81acba311153bea7d7905d11d9283f279470b545b', 'id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b3a659c-b67e-4237-9cd6-556467ee5723/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Trying to clone 60d57789-e20c-4348-aef7-bae89f6437e9 from image 1b3a659c-b67e-4237-9cd6-556467ee5723 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}]). {{(pid=86852) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 0 in 0.787s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 11:35:45 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Image download 0.00 MB at 0.00 MB/s Jul 08 11:35:45 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:35:45 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79598f6-8e49-405f-b6b8-65396d1a4c82]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:45 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:35:45 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:45 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e" returned: 0 in 0.818s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:45 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 1G Jul 08 11:35:45 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:45 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Temporary image cf17d0da-9230-4790-9c41-218d07381728 is fetched for user 4660f82e44ca428ea6f2e52ed849b05d. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[803cdccb-7036-4e5d-b576-ef4d14147698]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (e058f1cb-abb8-448d-82b9-756e61e5b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a213ea10-35eb-4470-9e4a-9c17b92b9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:35:46 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a213ea10-35eb-4470-9e4a-9c17b92b9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062713543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d323f93-3584-470e-960e-6cea81db7452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:46Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fc48b5-9223-4c1a-9f66-6ce707a3bab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fc48b5-9223-4c1a-9f66-6ce707a3bab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6057989d-c7c4-4223-b48f-862a530e274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6057989d-c7c4-4223-b48f-862a530e274e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d323f93-3584-470e-960e-6cea81db7452', 'volume_name': 'volume-2d323f93-3584-470e-960e-6cea81db7452', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c0a9f6-4e98-48dd-8306-6075b9b356b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c0a9f6-4e98-48dd-8306-6075b9b356b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d72f113-b8e5-4eb5-a95b-bd4c8cf8fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume 2d323f93-3584-470e-960e-6cea81db7452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d323f93-3584-470e-960e-6cea81db7452', 'volume_size': 1} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:46 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 0 in 1.014s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:46 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:35:46 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (61b41c01-5ac0-42ce-be07-b8807e3afeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85e6d6b-4154-4c87-9c6d-edf0097b4556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 1G" returned: 0 in 1.200s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85e6d6b-4154-4c87-9c6d-edf0097b4556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030686509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07d0ef4-2946-41d6-8d40-5d794d35841e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:47Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 Jul 08 11:35:46 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7904af40-fbae-4670-b530-426fd0fd72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7904af40-fbae-4670-b530-426fd0fd72f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c51f67a-6465-4996-b772-6a5d8b2eae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c51f67a-6465-4996-b772-6a5d8b2eae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07d0ef4-2946-41d6-8d40-5d794d35841e', 'volume_name': 'volume-b07d0ef4-2946-41d6-8d40-5d794d35841e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b22095-ef28-4035-82b9-84e35955513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b22095-ef28-4035-82b9-84e35955513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2952ad7-4a4a-4977-ad95-723e4fd6d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume b07d0ef4-2946-41d6-8d40-5d794d35841e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07d0ef4-2946-41d6-8d40-5d794d35841e', 'volume_size': 1} Jul 08 11:35:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:47 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 0 in 1.045s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (0d323fb1-fb89-422d-95f5-2acd8c3bd3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7782aace-4774-465c-9736-087410dfa531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7782aace-4774-465c-9736-087410dfa531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060504926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b3b4b-813a-40cf-b07c-954cce4abd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:47Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b92dded-bd6f-4374-ab59-c8fd9fb520ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b92dded-bd6f-4374-ab59-c8fd9fb520ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe8d00-fd8e-4fab-a3d4-373d5dab2257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fe8d00-fd8e-4fab-a3d4-373d5dab2257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017b3b4b-813a-40cf-b07c-954cce4abd78', 'volume_name': 'volume-017b3b4b-813a-40cf-b07c-954cce4abd78', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a61e5-4da4-4268-97bc-ff2484f0f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a61e5-4da4-4268-97bc-ff2484f0f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f0288e-3a55-474f-9b79-a72e6c8da3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume 017b3b4b-813a-40cf-b07c-954cce4abd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017b3b4b-813a-40cf-b07c-954cce4abd78', 'volume_size': 1} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:47 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 1 in 1.082s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Temporary image 1b3a659c-b67e-4237-9cd6-556467ee5723 is fetched for user 0de942f0c09d4eb585b8132624787c60. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab54c3-a098-4b78-8510-32f9a441eab0]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:47 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:35:47 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (b6da94b4-50e4-4bdc-814d-3a2e2e238ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41bb64d-db60-414e-85e9-d396a8aa80e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41bb64d-db60-414e-85e9-d396a8aa80e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267943934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd5a5c4-5487-4294-9e86-551ab94b1b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:48Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0baf8e48-4cee-442e-9b2f-0099adc431ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0baf8e48-4cee-442e-9b2f-0099adc431ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39c133d-66e7-430f-b69c-a4592660bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39c133d-66e7-430f-b69c-a4592660bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd5a5c4-5487-4294-9e86-551ab94b1b95', 'volume_name': 'volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f4596a-b3ba-409f-afae-cb5344b57454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f4596a-b3ba-409f-afae-cb5344b57454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0233e-40cb-400c-9f92-e5a8f12f25fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume 3bd5a5c4-5487-4294-9e86-551ab94b1b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95', 'volume_size': 1} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97" returned: 0 in 1.198s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:47 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 is being set with open permissions: ugo+rw Jul 08 11:35:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:47 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 Jul 08 11:35:47 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:48 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 1 in 1.033s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (cc550847-99f2-40a0-8d4a-234a9b2b6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b512bf-a677-4433-86cd-515539f53427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b512bf-a677-4433-86cd-515539f53427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696383545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:48Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728ddde6-2d81-43b8-b380-5db4af3c965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728ddde6-2d81-43b8-b380-5db4af3c965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37401566-eea0-45b0-b8f8-2daefb5e9440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37401566-eea0-45b0-b8f8-2daefb5e9440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a', 'volume_name': 'volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5d4a91-5b0d-4242-afec-76c0486bc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5d4a91-5b0d-4242-afec-76c0486bc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ad3c0-8590-4b57-b2f8-4fdc00be832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:48 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a', 'volume_size': 1} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:48 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 0 in 0.960s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:48 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:35:48 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:48 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:48 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info Jul 08 11:35:48 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:49 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:49 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:49 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info is being set with open permissions: ugo+rw Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:49 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info Jul 08 11:35:49 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:49 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.info" returned: 0 in 0.627s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.305s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.693s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2062713543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d323f93-3584-470e-960e-6cea81db7452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:46Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume 2d323f93-3584-470e-960e-6cea81db7452 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:49 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:49 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 1073741824 Jul 08 11:35:49 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-03cd0392-4f88-4897-acbc-37d159d84ecb tempest-CreateVolumesFromSnapshotTest-481869430 None] Create snapshot completed successfully Jul 08 11:35:50 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 1073741824" returned: 0 in 0.794s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:50 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 Jul 08 11:35:50 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (e17287de-0478-4fce-be6d-81a75174b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46380e4f-bf8f-445a-9bf3-6437417d1c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46380e4f-bf8f-445a-9bf3-6437417d1c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852812669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addeaa58-9ac9-4560-9924-117b86ad41d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:51Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae6e34b-a2bd-4785-bebc-67aa72639d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae6e34b-a2bd-4785-bebc-67aa72639d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5e1ab4-ac9e-4480-857d-5cbbe03bc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5e1ab4-ac9e-4480-857d-5cbbe03bc465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addeaa58-9ac9-4560-9924-117b86ad41d1', 'volume_name': 'volume-addeaa58-9ac9-4560-9924-117b86ad41d1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb91628-e330-49ec-ae8a-6b2e84680d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb91628-e330-49ec-ae8a-6b2e84680d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca35b48-0ca1-4e89-95b6-18447e7da1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume addeaa58-9ac9-4560-9924-117b86ad41d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addeaa58-9ac9-4560-9924-117b86ad41d1', 'volume_size': 1} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (b86ccd7b-b263-4fbc-bfaf-78cdc24e5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af0ac5-800c-4cae-a529-5c024fa5559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5af0ac5-800c-4cae-a529-5c024fa5559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1157186565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969a2521-100e-4445-a906-be1fa51bcbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:51Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee36eae-740c-4fc8-9bf5-c05b6edc8c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee36eae-740c-4fc8-9bf5-c05b6edc8c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe96101-6f61-427f-a836-dab54fb04781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe96101-6f61-427f-a836-dab54fb04781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969a2521-100e-4445-a906-be1fa51bcbb6', 'volume_name': 'volume-969a2521-100e-4445-a906-be1fa51bcbb6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4937ee4-55ef-4ca7-a3bd-31d57f2dbfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4937ee4-55ef-4ca7-a3bd-31d57f2dbfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac1225e-7ad9-486e-9988-6d8419a7b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume 969a2521-100e-4445-a906-be1fa51bcbb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969a2521-100e-4445-a906-be1fa51bcbb6', 'volume_size': 1} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452" returned: 0 in 0.769s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.725s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030686509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07d0ef4-2946-41d6-8d40-5d794d35841e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:47Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume b07d0ef4-2946-41d6-8d40-5d794d35841e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:51 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e 1073741824 Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d72f113-b8e5-4eb5-a95b-bd4c8cf8fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d323f93-3584-470e-960e-6cea81db7452', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dedcb7e-5d39-4394-b31e-e7940c9fcacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-2d323f93-3584-470e-960e-6cea81db7452 (2d323f93-3584-470e-960e-6cea81db7452): created successfully Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dedcb7e-5d39-4394-b31e-e7940c9fcacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (e058f1cb-abb8-448d-82b9-756e61e5b026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c791b952-cdb7-4233-9dc2-7c78c3271a59 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (d0f22da5-1254-4854-abe4-869b93a56ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb96814-ca23-475b-94a7-c43c3329ad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb96814-ca23-475b-94a7-c43c3329ad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961305255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:52Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2dac97-eb11-4e38-b5a1-12f49a5085ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2dac97-eb11-4e38-b5a1-12f49a5085ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c316f401-d920-410a-a26e-fad3b10f6cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c316f401-d920-410a-a26e-fad3b10f6cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f', 'volume_name': 'volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b239e34-0fa6-4fa0-b9be-6de7e90479af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b239e34-0fa6-4fa0-b9be-6de7e90479af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad62037-f59e-479e-880c-f21995d6b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:51 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume 8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f', 'volume_size': 1} Jul 08 11:35:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (38b7e035-a36f-439f-a5e3-eec5fceb1e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9aa793-1e51-401e-9ffe-717c220dc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9aa793-1e51-401e-9ffe-717c220dc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967637163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351bf6d0-e963-4fb8-8a46-40a9ec0c786e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:52Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0565bb82-24db-4c17-9527-5a2acc535c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0565bb82-24db-4c17-9527-5a2acc535c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce1a2e4-e8cc-4151-8481-ec946b8f89d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce1a2e4-e8cc-4151-8481-ec946b8f89d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351bf6d0-e963-4fb8-8a46-40a9ec0c786e', 'volume_name': 'volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e926cf5-0d2d-4952-8025-82e9f1b7e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e926cf5-0d2d-4952-8025-82e9f1b7e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f7bc5-ba53-4c93-9a69-4becfabeb06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume 351bf6d0-e963-4fb8-8a46-40a9ec0c786e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e', 'volume_size': 1} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:52 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:35:52 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:52 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e 1073741824" returned: 0 in 0.976s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e Jul 08 11:35:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (744d8619-058e-4d95-8639-3b6ad29a358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f4f09b-d277-47a8-97d2-f8dd813821c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f4f09b-d277-47a8-97d2-f8dd813821c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323732073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0361bf15-c1a9-4e76-911a-a2120205a366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:53Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcff2f87-a1ad-407d-a6dc-18822fed215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcff2f87-a1ad-407d-a6dc-18822fed215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13781287-cddf-4a54-bc18-ee629b19bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13781287-cddf-4a54-bc18-ee629b19bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0361bf15-c1a9-4e76-911a-a2120205a366', 'volume_name': 'volume-0361bf15-c1a9-4e76-911a-a2120205a366', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3585e-9aba-4949-bfb1-2deba4ad7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd3585e-9aba-4949-bfb1-2deba4ad7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a01ff3-0df5-4bc5-b6d8-acbd6589f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:52 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume 0361bf15-c1a9-4e76-911a-a2120205a366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0361bf15-c1a9-4e76-911a-a2120205a366', 'volume_size': 1} Jul 08 11:35:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:53 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.713s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:35:53 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.916s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060504926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b3b4b-813a-40cf-b07c-954cce4abd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:47Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume 017b3b4b-813a-40cf-b07c-954cce4abd78 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:53 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2952ad7-4a4a-4977-ad95-723e4fd6d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07d0ef4-2946-41d6-8d40-5d794d35841e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:53 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 1073741824 Jul 08 11:35:53 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e690b77-6ac5-4f95-b2af-88591e94792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:53 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-b07d0ef4-2946-41d6-8d40-5d794d35841e (b07d0ef4-2946-41d6-8d40-5d794d35841e): created successfully Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e690b77-6ac5-4f95-b2af-88591e94792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (61b41c01-5ac0-42ce-be07-b8807e3afeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e5baff6d-f923-4c27-aca9-37c8a07ceaa2 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:54 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 1073741824" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:54 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 Jul 08 11:35:54 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:54 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78" returned: 0 in 0.643s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.853s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1267943934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd5a5c4-5487-4294-9e86-551ab94b1b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:48Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume 3bd5a5c4-5487-4294-9e86-551ab94b1b95 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:54 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:54 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 1073741824 Jul 08 11:35:54 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f0288e-3a55-474f-9b79-a72e6c8da3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017b3b4b-813a-40cf-b07c-954cce4abd78', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514a627b-d875-492c-98b1-10d27dcb876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:54 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-017b3b4b-813a-40cf-b07c-954cce4abd78 (017b3b4b-813a-40cf-b07c-954cce4abd78): created successfully Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514a627b-d875-492c-98b1-10d27dcb876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (0d323fb1-fb89-422d-95f5-2acd8c3bd3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a52a015c-30d5-4557-b073-c9e5bd21c646 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:55 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 1073741824" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:55 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 Jul 08 11:35:55 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:56 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95" returned: 0 in 0.648s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.171s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efd30334-dc47-46a3-945e-ddf11e918ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e98e2e18f1d48d58a8fc75ac820b508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:44Z,use_quota=True,user_id='4660f82e44ca428ea6f2e52ed849b05d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Creating volume efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:56 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a0233e-40cb-400c-9f92-e5a8f12f25fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:56 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1073741824 Jul 08 11:35:56 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba8743b-1daa-4bcc-b6fd-29adcd1e2092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:56 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 (3bd5a5c4-5487-4294-9e86-551ab94b1b95): created successfully Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba8743b-1daa-4bcc-b6fd-29adcd1e2092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:56 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (b6da94b4-50e4-4bdc-814d-3a2e2e238ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-634efbee-d9d7-44b4-a049-2d77f2141f2a tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:57 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1073741824" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:57 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:35:57 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:57 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 0 in 0.639s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.514s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-696383545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aeb4b959869404181130ce73188d907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:48Z,use_quota=True,user_id='664461977e5249fa8d4f0f75af62f0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Creating volume d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:57 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:57 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a 1073741824 Jul 08 11:35:57 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Attempting download of cf17d0da-9230-4790-9c41-218d07381728 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}])) to volume efd30334-dc47-46a3-945e-ddf11e918ef2. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8928a4ef-ecdb-4d85-97ab-49b7dfc44f91]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:57 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e Jul 08 11:35:57 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:58 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e" returned: 0 in 0.733s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:58 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a 1073741824" returned: 0 in 0.844s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:58 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a Jul 08 11:35:58 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:58 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e Jul 08 11:35:58 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:59 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e" returned: 1 in 0.718s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf17d0da-9230-4790-9c41-218d07381728_uw1jpa4e' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6845181a-b737-465f-91f5-1dc4ed2e5064]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:59 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" returned: 0 in 0.690s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.168s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d57789-e20c-4348-aef7-bae89f6437e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7418456c176f4b269a18583406fb50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:45Z,use_quota=True,user_id='0de942f0c09d4eb585b8132624787c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc1f4a-9b87-47da-899f-571bc96cc097),volume_type_id=b0fc1f4a-9b87-47da-899f-571bc96cc097)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Creating volume 60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:35:59 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ad3c0-8590-4b57-b2f8-4fdc00be832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:59 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1073741824 Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed4951a-d115-4b68-94e3-e3653eb012c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:35:59 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:35:59 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Volume volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a (d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a): created successfully Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed4951a-d115-4b68-94e3-e3653eb012c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:35:59 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Flow 'volume_create_manager' (cc550847-99f2-40a0-8d4a-234a9b2b6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:35:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8b554e8d-054b-4442-a4e4-f69140f94de0 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created volume successfully. Jul 08 11:35:59 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:35:59 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:00 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD Jul 08 11:36:00 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[7417e514-2b9d-436d-9aec-d627acc02bce]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:00 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1073741824" returned: 0 in 0.943s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:00 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a Jul 08 11:36:00 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:00 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:00 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD" returned: 1 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] cf17d0da-9230-4790-9c41-218d07381728 was raw, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:00 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:00 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:00 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.764s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:00 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a Jul 08 11:36:00 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852812669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addeaa58-9ac9-4560-9924-117b86ad41d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:51Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume addeaa58-9ac9-4560-9924-117b86ad41d1 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:01 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:01 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 1073741824 Jul 08 11:36:01 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Attempting download of 1b3a659c-b67e-4237-9cd6-556467ee5723 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}])) to volume 60d57789-e20c-4348-aef7-bae89f6437e9. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77c0b3-009b-48b0-b5d1-e66a1544281a]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:01 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5 Jul 08 11:36:01 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:01 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 0 in 0.762s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf17d0da-9230-4790-9c41-218d07381728_alyatpf6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:36:01 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:01 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1G Jul 08 11:36:01 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:01 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" returned: 0 in 0.720s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a" released by "delete_volume" :: held 1.564s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['2a0894f1-2136-4a74-8711-5543c815c465', '28f589d9-c349-4efe-8b53-a8067d23990a', '345f6f33-9f48-4057-a811-db963b1d546d', '1116db1b-5f19-4158-8f04-e27e65c695dd'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:01 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:01 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:01 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5" returned: 0 in 0.874s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:02 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 1073741824" returned: 0 in 1.060s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:02 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5 Jul 08 11:36:02 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:02 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 Jul 08 11:36:02 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:02 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 1G" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-3bd5a5c4-5487-4294-9e86-551ab94b1b95-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed8cf39-3c1c-4997-81f7-1e92a447f85c]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-3bd5a5c4-5487-4294-9e86-551ab94b1b95-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-3bd5a5c4-5487-4294-9e86-551ab94b1b95" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-3bd5a5c4-5487-4294-9e86-551ab94b1b95" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfad2b6-fccc-473b-a656-3f0bde5d1c41]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:02 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:02 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:02 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 Jul 08 11:36:02 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:02 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.922s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4472e252-c3a7-4322-a585-adc74a46e9bf tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-d93ef3fb-0bb4-4fba-85f1-9700dcbc7a1a-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:02 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5" returned: 1 in 1.002s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b3a659c-b67e-4237-9cd6-556467ee5723_32rfs5l5' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f0ea1-295b-4e64-9782-359b800895d1]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:03 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1" returned: 0 in 0.904s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.516s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1157186565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969a2521-100e-4445-a906-be1fa51bcbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:51Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume 969a2521-100e-4445-a906-be1fa51bcbb6 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:03 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 1073741824 Jul 08 11:36:03 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca35b48-0ca1-4e89-95b6-18447e7da1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addeaa58-9ac9-4560-9924-117b86ad41d1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a700628-bf9a-4162-905b-37a0a382c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:03 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-addeaa58-9ac9-4560-9924-117b86ad41d1 (addeaa58-9ac9-4560-9924-117b86ad41d1): created successfully Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a700628-bf9a-4162-905b-37a0a382c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:03 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:36:03 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (e17287de-0478-4fce-be6d-81a75174b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-895c0cf2-785f-4012-b750-163fb57629a1 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:36:03 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95" returned: 0 in 0.902s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:03 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95 Jul 08 11:36:03 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:03 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 0 in 1.128s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:03 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:03 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:03 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD Jul 08 11:36:04 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:04 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 1073741824" returned: 0 in 0.983s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 Jul 08 11:36:04 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:04 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3bd5a5c4-5487-4294-9e86-551ab94b1b95" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-3bd5a5c4-5487-4294-9e86-551ab94b1b95" released by "delete_volume" :: held 1.730s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['02e2996c-30df-41d4-b370-99600ddfae5e', 'de5b494b-261c-4a8f-a4b7-b24531b3d6d6', '8cfaabcb-28cd-448e-bbe3-eecf0285e0d5', '6897d53f-b225-4417-91f0-2d1e2bd51ae5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:04 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:04 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 1 in 0.934s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Downloaded image cf17d0da-9230-4790-9c41-218d07381728 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}])) to volume efd30334-dc47-46a3-945e-ddf11e918ef2 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Temporary image cf17d0da-9230-4790-9c41-218d07381728 for user 4660f82e44ca428ea6f2e52ed849b05d is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Marking volume efd30334-dc47-46a3-945e-ddf11e918ef2 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Copying metadata from image cf17d0da-9230-4790-9c41-218d07381728 to efd30334-dc47-46a3-945e-ddf11e918ef2. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Creating volume glance metadata for volume efd30334-dc47-46a3-945e-ddf11e918ef2 backed by image cf17d0da-9230-4790-9c41-218d07381728 with: {'image_id': 'cf17d0da-9230-4790-9c41-218d07381728', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eb8de153a1eff4633ce6706863a3ce2f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4539f4b7-c88a-43fd-a9b5-ef15f410dd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efd30334-dc47-46a3-945e-ddf11e918ef2', 'volume_size': 1, 'image_id': 'cf17d0da-9230-4790-9c41-218d07381728', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf17d0da-9230-4790-9c41-218d07381728', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb8de153a1eff4633ce6706863a3ce2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8e98e2e18f1d48d58a8fc75ac820b508', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d11a27ce46ed2b57fbdb6d572f29250a9967911b93336b733e35de2d81cc945abe5981c2932582093caab0198bd7c93f4adf08f9ad950bdf071a3ef2dc0979', 'id': 'cf17d0da-9230-4790-9c41-218d07381728', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf17d0da-9230-4790-9c41-218d07381728/file', 'properties': {}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1361965a-6f9d-4873-a6a4-c48d223b7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Volume volume-efd30334-dc47-46a3-945e-ddf11e918ef2 (efd30334-dc47-46a3-945e-ddf11e918ef2): created successfully Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1361965a-6f9d-4873-a6a4-c48d223b7627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Flow 'volume_create_manager' (d8f39992-bde2-4514-b773-cb3e21dcfe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9f88e6e8-4e2f-49b5-a7d2-6bcd66b8d86d tempest-VolumeImageDependencyTests-1983677937 None] Created volume successfully. Jul 08 11:36:04 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-017b3b4b-813a-40cf-b07c-954cce4abd78-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD" returned: 1 in 0.847s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] 1b3a659c-b67e-4237-9cd6-556467ee5723 was raw, converting to raw {{(pid=86852) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-017b3b4b-813a-40cf-b07c-954cce4abd78-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:04 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:04 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-017b3b4b-813a-40cf-b07c-954cce4abd78" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-017b3b4b-813a-40cf-b07c-954cce4abd78" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:04 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6" returned: 0 in 0.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961305255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:52Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume 8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:04 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a829e2a8-c5da-408f-8293-417c3a93e974]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:04 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f 1073741824 Jul 08 11:36:04 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac1225e-7ad9-486e-9988-6d8419a7b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969a2521-100e-4445-a906-be1fa51bcbb6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f63b76-773d-4815-b79a-d1fbb13cab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-969a2521-100e-4445-a906-be1fa51bcbb6 (969a2521-100e-4445-a906-be1fa51bcbb6): created successfully Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f63b76-773d-4815-b79a-d1fbb13cab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (b86ccd7b-b263-4fbc-bfaf-78cdc24e5976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4282af4a-2751-4128-a810-bbf149e261c0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:36:05 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 Jul 08 11:36:05 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:05 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.832s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3cc6bb72-af4f-46a4-8abc-1fc2d6d2a6e4 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-3bd5a5c4-5487-4294-9e86-551ab94b1b95-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Acquiring lock "cinder-efd30334-dc47-46a3-945e-ddf11e918ef2-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "cinder-efd30334-dc47-46a3-945e-ddf11e918ef2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Acquiring lock "cinder-quobyte-efd30334-dc47-46a3-945e-ddf11e918ef2" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "cinder-quobyte-efd30334-dc47-46a3-945e-ddf11e918ef2" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e23a27-c3cd-4214-91b4-6b7b9839030b]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:05 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 0 in 1.006s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b3a659c-b67e-4237-9cd6-556467ee5723_1xj0cuyodevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:36:05 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:05 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1G Jul 08 11:36:05 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:05 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78" returned: 0 in 0.950s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:05 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:05 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:05 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78 Jul 08 11:36:05 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f 1073741824" returned: 0 in 1.123s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:06 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f Jul 08 11:36:06 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 1G" returned: 0 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:06 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-017b3b4b-813a-40cf-b07c-954cce4abd78" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:06 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 0 in 0.842s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-017b3b4b-813a-40cf-b07c-954cce4abd78" released by "delete_volume" :: held 1.743s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1995101a-ee83-499d-9eb8-cd75ffe81957]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['490bddd7-96e5-4210-9bb8-1a1f099c75b3', 'd2b7499d-e4e8-4920-95ee-9e1836553f07', '5e21a38a-37f0-4264-a5cf-f49476fff94e', 'e0584851-a9fc-412e-a4bb-6baeecdb482e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:06 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:06 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:06 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:06 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" returned: 0 in 0.756s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.540s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967637163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351bf6d0-e963-4fb8-8a46-40a9ec0c786e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:52Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume 351bf6d0-e963-4fb8-8a46-40a9ec0c786e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:06 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:06 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:06 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad62037-f59e-479e-880c-f21995d6b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40950ee4-e5f4-4cc1-845b-132578210aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:06 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e 1073741824 Jul 08 11:36:06 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f (8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f): created successfully Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40950ee4-e5f4-4cc1-845b-132578210aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (d0f22da5-1254-4854-abe4-869b93a56ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fba46f10-7c42-43e7-8642-ad869181f24b tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-b07d0ef4-2946-41d6-8d40-5d794d35841e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-b07d0ef4-2946-41d6-8d40-5d794d35841e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-b07d0ef4-2946-41d6-8d40-5d794d35841e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-b07d0ef4-2946-41d6-8d40-5d794d35841e" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da85870-922d-4477-9a30-4831d391ed5e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:07 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e Jul 08 11:36:07 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:07 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 0 in 1.022s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:07 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 1 in 1.069s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:07 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2 Jul 08 11:36:07 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:07 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.940s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-465dc99e-4eaa-41f8-bafd-eab0d72f5d64 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-017b3b4b-813a-40cf-b07c-954cce4abd78-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:07 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:07 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:07 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e 1073741824" returned: 0 in 1.102s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:08 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e Jul 08 11:36:08 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:08 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e" returned: 0 in 1.129s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:08 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e Jul 08 11:36:08 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:08 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-efd30334-dc47-46a3-945e-ddf11e918ef2" returned: 0 in 0.791s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "cinder-quobyte-efd30334-dc47-46a3-945e-ddf11e918ef2" released by "delete_volume" :: held 2.782s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Created reservations ['7c02a8d0-98ed-4373-ab47-04147b8daa82', '8a7553bc-3e63-4c06-93e9-60f18be00516', 'f3a87557-4bd3-4e7c-ab20-81298b522703', 'd4d075d0-2452-46ac-a1ae-2bab2f66e48f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:08 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 1 in 0.920s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Downloaded image 1b3a659c-b67e-4237-9cd6-556467ee5723 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}])) to volume 60d57789-e20c-4348-aef7-bae89f6437e9 successfully. {{(pid=86852) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Temporary image 1b3a659c-b67e-4237-9cd6-556467ee5723 for user 0de942f0c09d4eb585b8132624787c60 is deleted. {{(pid=86852) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.volume_utils [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Marking volume 60d57789-e20c-4348-aef7-bae89f6437e9 as bootable. {{(pid=86852) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Copying metadata from image 1b3a659c-b67e-4237-9cd6-556467ee5723 to 60d57789-e20c-4348-aef7-bae89f6437e9. {{(pid=86852) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Creating volume glance metadata for volume 60d57789-e20c-4348-aef7-bae89f6437e9 backed by image 1b3a659c-b67e-4237-9cd6-556467ee5723 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'eb72394c9fdec669bfdf236d5d42f493', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86852) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:08 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:08 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225c290d-ed7d-4b0a-b505-b211d4897653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d57789-e20c-4348-aef7-bae89f6437e9', 'volume_size': 1, 'image_id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b3a659c-b67e-4237-9cd6-556467ee5723', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb72394c9fdec669bfdf236d5d42f493', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7418456c176f4b269a18583406fb50a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ead7fc7ab96397ed3aac753f8765350db8b92ca01ccfb3bddb36b621c808ec66b9b3f1de75675aabd5bafce81acba311153bea7d7905d11d9283f279470b545b', 'id': '1b3a659c-b67e-4237-9cd6-556467ee5723', 'created_at': datetime.datetime(2026, 7, 8, 9, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 9, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b3a659c-b67e-4237-9cd6-556467ee5723/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936c66c9-303f-4ce0-8e73-418b948977ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Volume volume-60d57789-e20c-4348-aef7-bae89f6437e9 (60d57789-e20c-4348-aef7-bae89f6437e9): created successfully Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936c66c9-303f-4ce0-8e73-418b948977ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Flow 'volume_create_manager' (7321f172-5297-4eeb-9dd3-74e0eecabd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-270ad6ff-41ae-4276-8cd6-d71c8ecf754f tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Created volume successfully. Jul 08 11:36:08 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" returned: 0 in 0.778s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.042s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323732073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0361bf15-c1a9-4e76-911a-a2120205a366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b0ef32325547798d69189580f8c50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:35:53Z,use_quota=True,user_id='6c91d491873048e38516b90a0703ec9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Creating volume 0361bf15-c1a9-4e76-911a-a2120205a366 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:08 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:08 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 1073741824 Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f7bc5-ba53-4c93-9a69-4becfabeb06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:08 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398c745-bb8d-4c73-8852-6b48852f572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e (351bf6d0-e963-4fb8-8a46-40a9ec0c786e): created successfully Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398c745-bb8d-4c73-8852-6b48852f572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (38b7e035-a36f-439f-a5e3-eec5fceb1e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1629e26e-68fa-4196-a5bb-242e53cae6fa tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:36:09 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b07d0ef4-2946-41d6-8d40-5d794d35841e" returned: 0 in 0.782s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-b07d0ef4-2946-41d6-8d40-5d794d35841e" released by "delete_volume" :: held 1.960s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['f5e388bc-0627-4b1a-af54-95f26b27b89e', '7863eace-486d-4bac-a292-873b5bf5e13b', 'a060a51b-48f2-4bd7-839c-f4c5f8d5a56c', 'fd8ed3fe-535b-4c62-aa26-c7086dae0401'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:09 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:09 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-2d323f93-3584-470e-960e-6cea81db7452-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-2d323f93-3584-470e-960e-6cea81db7452-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-2d323f93-3584-470e-960e-6cea81db7452" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-2d323f93-3584-470e-960e-6cea81db7452" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f6757-1b85-4529-baab-c1c8e3ee9af1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:09 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.002s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Deleted volume successfully. Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-aaa11700-ea8c-4a21-9491-658c4a7738dc tempest-VolumeImageDependencyTests-1983677937 None] Lock "cinder-efd30334-dc47-46a3-945e-ddf11e918ef2-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:09 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 Jul 08 11:36:09 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Acquiring lock "cinder-60d57789-e20c-4348-aef7-bae89f6437e9-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "cinder-60d57789-e20c-4348-aef7-bae89f6437e9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Acquiring lock "cinder-quobyte-60d57789-e20c-4348-aef7-bae89f6437e9" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "cinder-quobyte-60d57789-e20c-4348-aef7-bae89f6437e9" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf9c28-9078-46e7-91c2-3ffd2b05b68e]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:10 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 1073741824" returned: 0 in 1.225s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:10 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 Jul 08 11:36:10 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:10 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:10 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:10 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.192s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-7b295563-6117-47f5-86a3-5fa6c54d4940 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-b07d0ef4-2946-41d6-8d40-5d794d35841e-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:10 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452" returned: 0 in 1.144s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:10 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452 Jul 08 11:36:10 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:10 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a01ff3-0df5-4bc5-b6d8-acbd6589f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0361bf15-c1a9-4e76-911a-a2120205a366', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128716db-52f6-4941-8376-022a4d1872e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:10 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Volume volume-0361bf15-c1a9-4e76-911a-a2120205a366 (0361bf15-c1a9-4e76-911a-a2120205a366): created successfully Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128716db-52f6-4941-8376-022a4d1872e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Flow 'volume_create_manager' (744d8619-058e-4d95-8639-3b6ad29a358a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7e8daff7-d58c-4977-b298-b14ea78c7f89 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created volume successfully. Jul 08 11:36:10 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 0 in 0.983s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:11 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:11 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-0361bf15-c1a9-4e76-911a-a2120205a366-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-0361bf15-c1a9-4e76-911a-a2120205a366-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-0361bf15-c1a9-4e76-911a-a2120205a366" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-0361bf15-c1a9-4e76-911a-a2120205a366" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[818aa054-5c42-4701-9bd6-c6c47c7551bb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:11 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2d323f93-3584-470e-960e-6cea81db7452" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-2d323f93-3584-470e-960e-6cea81db7452" released by "delete_volume" :: held 2.058s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:11 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 Jul 08 11:36:11 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['2301847b-709d-40ef-967d-2a28dce0ff5e', '40631f6b-e125-475f-8928-52d1ad60710f', '82cd6c66-f42a-4d78-85fa-4e76a4a4d46c', '6b0a18d8-d7a7-4601-8502-7a010e02fb38'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:11 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:11 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-c981ec59-4527-46fc-9553-4b8fd54844ed-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-c981ec59-4527-46fc-9553-4b8fd54844ed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "cinder-quobyte-c981ec59-4527-46fc-9553-4b8fd54844ed" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-c981ec59-4527-46fc-9553-4b8fd54844ed" acquired by "delete_volume" :: waited 0.033s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:11 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 1 in 1.018s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9' failed. Not Retrying. {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:11 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[89788cc8-edb6-476e-948a-6f823570e027]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:12 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9 Jul 08 11:36:12 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:12 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed Jul 08 11:36:12 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:12 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.772s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-68a74c03-dc80-4b53-b825-234e01ee7930 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-2d323f93-3584-470e-960e-6cea81db7452-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:12 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366" returned: 0 in 1.304s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:12 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366 Jul 08 11:36:12 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:12 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed" returned: 0 in 0.863s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:12 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed Jul 08 11:36:12 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:12 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-60d57789-e20c-4348-aef7-bae89f6437e9" returned: 0 in 0.943s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "cinder-quobyte-60d57789-e20c-4348-aef7-bae89f6437e9" released by "delete_volume" :: held 3.040s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Created reservations ['44e29da1-67cf-4fe0-8bd4-9f37b4300936', '8fbbef6d-825d-492a-a8f9-02705e024d64', '75c6732b-5d2c-4e10-95d7-67c8d2768d21', 'fec6807c-31a7-4678-bf79-ff83db846516'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:13 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:13 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:13 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Flow 'volume_create_manager' (b3fccb92-1694-4499-b816-02f1f22e9633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a812813-ba8f-410a-99bb-1925db4baebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-0361bf15-c1a9-4e76-911a-a2120205a366" returned: 0 in 0.910s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a812813-ba8f-410a-99bb-1925db4baebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f743c09-8a93-4534-841c-84022658517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb8b0c6bebe432d9ea71beedb5f37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:14Z,use_quota=True,user_id='822332ec72c24e2397a1f3c314ef7764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccfdf99-846f-4eb8-a369-4bfebe09b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccfdf99-846f-4eb8-a369-4bfebe09b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f0e4be-bcc5-48ae-a7f5-3677cf110982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f0e4be-bcc5-48ae-a7f5-3677cf110982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f743c09-8a93-4534-841c-84022658517c', 'volume_name': 'volume-6f743c09-8a93-4534-841c-84022658517c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f4eee6-3074-4d68-8d8e-3dddee7eca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f4eee6-3074-4d68-8d8e-3dddee7eca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6104748-4805-429d-adc2-75b56c6af6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:13 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Volume 6f743c09-8a93-4534-841c-84022658517c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f743c09-8a93-4534-841c-84022658517c', 'volume_size': 1} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f743c09-8a93-4534-841c-84022658517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb8b0c6bebe432d9ea71beedb5f37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:14Z,use_quota=True,user_id='822332ec72c24e2397a1f3c314ef7764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Creating volume 6f743c09-8a93-4534-841c-84022658517c {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:13 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-0361bf15-c1a9-4e76-911a-a2120205a366" released by "delete_volume" :: held 2.331s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:13 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c 1073741824 Jul 08 11:36:13 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:13 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c981ec59-4527-46fc-9553-4b8fd54844ed" returned: 0 in 1.006s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-quobyte-c981ec59-4527-46fc-9553-4b8fd54844ed" released by "delete_volume" :: held 1.954s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['4d80dd24-cbb8-4326-92de-743f5b8a7eab', 'd60264b6-5205-45fc-b62a-6d03769f1fd9', '853212c7-83c2-40ad-b4a2-4b7af25f0e47', 'a219ca33-7e5b-4e5c-9298-b2d4ca392f55'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Created reservations ['155ed57a-52e4-4021-b4b9-0a9edd4eee0a', 'fff3e666-7285-42d4-b074-9e0a691d289a', 'f4bd1105-0d7b-471b-be1c-99e6519943cf', '5abcaa44-a152-4209-90c3-a241872fabcc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:14 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:14 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.976s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:14 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Deleted volume successfully. Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c761912b-b281-44e4-939a-461faaa440af tempest-VolumeAndVolumeTypeFromImageTest-1987623594 None] Lock "cinder-60d57789-e20c-4348-aef7-bae89f6437e9-delete_volume" released by "delete_volume" :: held 4.317s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:14 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:14 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:14 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c 1073741824" returned: 0 in 1.085s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-351bf6d0-e963-4fb8-8a46-40a9ec0c786e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:14 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.865s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-351bf6d0-e963-4fb8-8a46-40a9ec0c786e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:14 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c Jul 08 11:36:14 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:14 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-abe1bd76-161b-420c-aceb-ba2322a6361b tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-0361bf15-c1a9-4e76-911a-a2120205a366-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.785s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Deleted volume successfully. Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3acb7536-8fff-48ad-b507-067de73a5af7 tempest-CreateVolumesFromSourceVolumeTest-415496258 None] Lock "cinder-c981ec59-4527-46fc-9553-4b8fd54844ed-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9e169-a45a-45ee-8a98-6435efebb47e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:15 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e Jul 08 11:36:15 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:15 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c" returned: 0 in 0.755s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6104748-4805-429d-adc2-75b56c6af6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f743c09-8a93-4534-841c-84022658517c', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ec872-1274-427d-917a-ef4969a5b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:15 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Volume volume-6f743c09-8a93-4534-841c-84022658517c (6f743c09-8a93-4534-841c-84022658517c): created successfully Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4ec872-1274-427d-917a-ef4969a5b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:15 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Flow 'volume_create_manager' (b3fccb92-1694-4499-b816-02f1f22e9633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8347260b-7577-4178-9856-ca66d2e02e31 tempest-CinderUnicodeTest-384901371 None] Created volume successfully. Jul 08 11:36:16 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" returned: 0 in 0.991s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:16 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e Jul 08 11:36:16 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Flow 'volume_create_manager' (6cdc9658-ca11-41b5-a2ff-9317a72c5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee2bd01-f4e3-4a94-bf32-cd8e33748fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee2bd01-f4e3-4a94-bf32-cd8e33748fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2058418777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458d3d51-23ad-4398-818f-299a1d6714ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb8b0c6bebe432d9ea71beedb5f37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:17Z,use_quota=True,user_id='822332ec72c24e2397a1f3c314ef7764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac23e86-2dd1-4078-88ba-d0aab92518d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac23e86-2dd1-4078-88ba-d0aab92518d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825cce7f-acec-4c46-82b5-e2f117051264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825cce7f-acec-4c46-82b5-e2f117051264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458d3d51-23ad-4398-818f-299a1d6714ae', 'volume_name': 'volume-458d3d51-23ad-4398-818f-299a1d6714ae', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd9a6dd-7d81-4904-9635-929dd5d47ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd9a6dd-7d81-4904-9635-929dd5d47ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d950c4c-59b4-4391-a04c-b294b8b0311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Volume 458d3d51-23ad-4398-818f-299a1d6714ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458d3d51-23ad-4398-818f-299a1d6714ae', 'volume_size': 1} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2058418777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458d3d51-23ad-4398-818f-299a1d6714ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb8b0c6bebe432d9ea71beedb5f37bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:17Z,use_quota=True,user_id='822332ec72c24e2397a1f3c314ef7764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Creating volume 458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:16 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:16 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae 1073741824 Jul 08 11:36:16 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:16 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" returned: 0 in 0.874s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:16 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-351bf6d0-e963-4fb8-8a46-40a9ec0c786e" released by "delete_volume" :: held 1.928s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['460d5e60-7992-478d-a9b8-d9efef02101d', 'de1eea4d-572f-40a5-b942-6d0c01a1d1fe', 'd78c27f7-03e1-4a06-a321-fe4acf5fe203', '529cd307-ba31-482c-b6d6-96d1db0a698c'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:17 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:17 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2db90-b610-4a4b-adf4-ed50b824f1c8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:17 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f Jul 08 11:36:17 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:17 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:17 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:17 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5a933270-e23e-4f70-b5fb-8cb6f4c1cfe4 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-351bf6d0-e963-4fb8-8a46-40a9ec0c786e-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:18 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae 1073741824" returned: 0 in 1.208s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:18 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae Jul 08 11:36:18 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:18 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" returned: 0 in 1.004s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:18 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f Jul 08 11:36:18 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:18 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae" returned: 0 in 0.790s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d950c4c-59b4-4391-a04c-b294b8b0311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458d3d51-23ad-4398-818f-299a1d6714ae', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8781ffb-5473-443e-bd60-055a9697e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:18 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Volume volume-458d3d51-23ad-4398-818f-299a1d6714ae (458d3d51-23ad-4398-818f-299a1d6714ae): created successfully Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8781ffb-5473-443e-bd60-055a9697e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:18 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Flow 'volume_create_manager' (6cdc9658-ca11-41b5-a2ff-9317a72c5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:19 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-298a843b-6305-4534-9d93-be629401b2ae tempest-CinderUnicodeTest-384901371 None] Created volume successfully. Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (e61b980a-5084-4df1-b246-d345135e193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e66d90-b1b0-4d21-8b9f-72e23a4b204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e66d90-b1b0-4d21-8b9f-72e23a4b204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861298428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5fce44-c751-4c8e-9367-42239f7e634d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:19Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8823ca-c943-482a-ac2a-860f738be072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8823ca-c943-482a-ac2a-860f738be072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c812ae-3cb8-495e-b92e-62a2b7c65278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c812ae-3cb8-495e-b92e-62a2b7c65278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5fce44-c751-4c8e-9367-42239f7e634d', 'volume_name': 'volume-2b5fce44-c751-4c8e-9367-42239f7e634d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719e82b0-1e50-4dae-b621-4569741d563e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719e82b0-1e50-4dae-b621-4569741d563e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ab9963-c0b2-43ef-8f52-7b61ed77ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Volume 2b5fce44-c751-4c8e-9367-42239f7e634d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5fce44-c751-4c8e-9367-42239f7e634d', 'volume_size': 1} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861298428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5fce44-c751-4c8e-9367-42239f7e634d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:19Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Creating volume 2b5fce44-c751-4c8e-9367-42239f7e634d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:19 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:19 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d 1073741824 Jul 08 11:36:19 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" returned: 0 in 0.905s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f" released by "delete_volume" :: held 1.975s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['3b8648d6-88e1-4793-9842-8d1ba5d5556b', '55c409d8-bbd1-4956-9be5-6c1146b889d0', 'ace50a00-879a-4b06-b9c8-830de392e7ce', '24756974-9ddf-4c98-8a72-b2af9d377308'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:19 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:19 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-969a2521-100e-4445-a906-be1fa51bcbb6-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-969a2521-100e-4445-a906-be1fa51bcbb6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (0d59387b-8d41-474c-8ef6-ffbd81c7513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c145093-3eb2-4cf8-8598-79433924ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c145093-3eb2-4cf8-8598-79433924ae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075136441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4213054-8fb2-4cf0-88e3-c900fa3f9d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:20Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d9a264-5239-4b77-8b5a-01a29ed65d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d9a264-5239-4b77-8b5a-01a29ed65d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1143f3d5-199d-4f5a-bb40-c711e643871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1143f3d5-199d-4f5a-bb40-c711e643871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4213054-8fb2-4cf0-88e3-c900fa3f9d72', 'volume_name': 'volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecbac5c-a351-4d46-bc4b-0f4bc32bb9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecbac5c-a351-4d46-bc4b-0f4bc32bb9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87d2b2a-84b3-4882-aed7-4334a04372f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:19 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume c4213054-8fb2-4cf0-88e3-c900fa3f9d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72', 'volume_size': 1} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-969a2521-100e-4445-a906-be1fa51bcbb6" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-969a2521-100e-4445-a906-be1fa51bcbb6" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed80bb1-9e4f-4b1f-843d-79377e0b4129]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:20 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 Jul 08 11:36:20 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (886cfd70-0e22-462f-aff0-026133c88ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78a1d54-3d5d-4e94-b601-069a7a9e07fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78a1d54-3d5d-4e94-b601-069a7a9e07fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594841834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a025f0-b4fa-4003-bc98-349ad7a5894a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:20Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b1ade8-bb50-4621-af33-d34695352e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b1ade8-bb50-4621-af33-d34695352e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349f22a-7d36-4ca8-81b5-a5fd6346e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1349f22a-7d36-4ca8-81b5-a5fd6346e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a025f0-b4fa-4003-bc98-349ad7a5894a', 'volume_name': 'volume-53a025f0-b4fa-4003-bc98-349ad7a5894a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d60c551-12c9-4212-868f-50b5a64e841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d60c551-12c9-4212-868f-50b5a64e841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1d4d8b-5aef-46de-be57-83f6d5b109b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume 53a025f0-b4fa-4003-bc98-349ad7a5894a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a025f0-b4fa-4003-bc98-349ad7a5894a', 'volume_size': 1} Jul 08 11:36:20 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.920s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-78cf851d-e164-44f0-8212-031038dbd8e0 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-8bfdb26d-a99c-46ad-b2ca-60ca8e9d5f8f-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:20 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d 1073741824" returned: 0 in 1.293s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:20 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d Jul 08 11:36:20 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (f7f4bdf4-f58e-47b6-8419-e57905395021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b238e57-5de5-48ed-ae77-15e56c55b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b238e57-5de5-48ed-ae77-15e56c55b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958464772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27e3eee-b3cd-4a61-9049-94843e5bac21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:21Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c5480c-1009-420f-823d-c06d784c5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c5480c-1009-420f-823d-c06d784c5035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04335e74-df1f-4be5-81c7-7f09652eccc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04335e74-df1f-4be5-81c7-7f09652eccc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27e3eee-b3cd-4a61-9049-94843e5bac21', 'volume_name': 'volume-a27e3eee-b3cd-4a61-9049-94843e5bac21', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a8f594-723f-4314-8e11-a043d6482a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a8f594-723f-4314-8e11-a043d6482a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea229e8f-2126-435b-9b9f-d2aa3941e389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:20 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Volume a27e3eee-b3cd-4a61-9049-94843e5bac21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27e3eee-b3cd-4a61-9049-94843e5bac21', 'volume_size': 1} Jul 08 11:36:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:21 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6" returned: 0 in 1.220s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:21 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6 Jul 08 11:36:21 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (4ba30694-efd6-4512-909f-c9c3d9906044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f880792-3a5d-48ea-bd0b-ad553c81048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f880792-3a5d-48ea-bd0b-ad553c81048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-289453926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab99f37-83ce-4484-b182-6ab74b5c78df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:21Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647bbba5-97cd-411b-a956-ad97bfb1ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647bbba5-97cd-411b-a956-ad97bfb1ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb289433-f2e2-4f8f-b09f-84f729568376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb289433-f2e2-4f8f-b09f-84f729568376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab99f37-83ce-4484-b182-6ab74b5c78df', 'volume_name': 'volume-5ab99f37-83ce-4484-b182-6ab74b5c78df', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f942a5a-6c56-471a-9522-6535bd5dddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f942a5a-6c56-471a-9522-6535bd5dddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccc3c13-0820-4901-aa58-e676aa3db20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Volume 5ab99f37-83ce-4484-b182-6ab74b5c78df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab99f37-83ce-4484-b182-6ab74b5c78df', 'volume_size': 1} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:21 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d" returned: 0 in 1.003s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075136441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4213054-8fb2-4cf0-88e3-c900fa3f9d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:20Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Creating volume c4213054-8fb2-4cf0-88e3-c900fa3f9d72 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:21 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:21 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 1073741824 Jul 08 11:36:21 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ab9963-c0b2-43ef-8f52-7b61ed77ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5fce44-c751-4c8e-9367-42239f7e634d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512abb1f-ddf7-48d8-9857-2787d25b88c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:21 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Volume volume-2b5fce44-c751-4c8e-9367-42239f7e634d (2b5fce44-c751-4c8e-9367-42239f7e634d): created successfully Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512abb1f-ddf7-48d8-9857-2787d25b88c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (e61b980a-5084-4df1-b246-d345135e193f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fb45d3c9-59f3-43ee-a565-2d9cc2c58bdd tempest-CreateVolumesFromImageTest-1304654659 None] Created volume successfully. Jul 08 11:36:21 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-969a2521-100e-4445-a906-be1fa51bcbb6" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-969a2521-100e-4445-a906-be1fa51bcbb6" released by "delete_volume" :: held 2.105s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['d2138a3e-b004-41a0-83dc-2ec86ed774f8', '1e1124fc-4d0f-4e6b-ac25-e96b47ea3264', 'f0d1bfb6-b24e-4f44-b524-2f6bb4b75221', '64a2531b-b438-4ba8-bdef-b2b9d745a365'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:22 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:22 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-addeaa58-9ac9-4560-9924-117b86ad41d1-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-addeaa58-9ac9-4560-9924-117b86ad41d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-addeaa58-9ac9-4560-9924-117b86ad41d1" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-addeaa58-9ac9-4560-9924-117b86ad41d1" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8bb8f-d25f-486b-aea2-ef3c55d917d2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:22 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 Jul 08 11:36:22 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:22 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 1073741824" returned: 0 in 1.122s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:22 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 Jul 08 11:36:22 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:22 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.857s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:23 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c1b7662f-f958-4f91-a70d-fd30ec08c5d5 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-969a2521-100e-4445-a906-be1fa51bcbb6-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:23 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1" returned: 0 in 0.906s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:23 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1 Jul 08 11:36:23 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:23 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" returned: 0 in 0.791s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.122s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594841834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a025f0-b4fa-4003-bc98-349ad7a5894a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:20Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Creating volume 53a025f0-b4fa-4003-bc98-349ad7a5894a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:23 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:23 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a 1073741824 Jul 08 11:36:23 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87d2b2a-84b3-4882-aed7-4334a04372f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225a791c-fdf8-4cb6-9575-8f0cc620d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:23 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 (c4213054-8fb2-4cf0-88e3-c900fa3f9d72): created successfully Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225a791c-fdf8-4cb6-9575-8f0cc620d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:23 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (0d59387b-8d41-474c-8ef6-ffbd81c7513c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:23 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-92f42db4-6ecd-43d3-80d7-30c2ddc36bc2 tempest-CreateVolumesFromImageTest-1304654659 None] Created volume successfully. Jul 08 11:36:24 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-addeaa58-9ac9-4560-9924-117b86ad41d1" returned: 0 in 0.728s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-addeaa58-9ac9-4560-9924-117b86ad41d1" released by "delete_volume" :: held 1.677s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['3e2f1cc2-a102-4b5f-8af1-e6eeccd440b6', '2240bc39-db13-4d4b-ade3-00334db6dfb4', '249e2180-621f-4036-9668-40d106b438f2', 'd9f75000-0e5e-494d-8a07-0a94031f5973'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:24 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:24 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:24 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a 1073741824" returned: 0 in 0.937s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:24 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a Jul 08 11:36:24 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-e73277d5-017a-4246-ba7d-367cb1e7ca97-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-e73277d5-017a-4246-ba7d-367cb1e7ca97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-e73277d5-017a-4246-ba7d-367cb1e7ca97" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-e73277d5-017a-4246-ba7d-367cb1e7ca97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleting offline snapshot e73277d5-017a-4246-ba7d-367cb1e7ca97 of volume ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] snapshot_file for this snap is: volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[565d967c-6d01-491c-b9df-caadffd71aaf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:25 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 Jul 08 11:36:25 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:25 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b00717fd-cb09-40c5-88bb-604f72c2f2ee tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-addeaa58-9ac9-4560-9924-117b86ad41d1-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:25 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a" returned: 0 in 0.794s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.414s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-958464772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27e3eee-b3cd-4a61-9049-94843e5bac21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:21Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Creating volume a27e3eee-b3cd-4a61-9049-94843e5bac21 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:25 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1d4d8b-5aef-46de-be57-83f6d5b109b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a025f0-b4fa-4003-bc98-349ad7a5894a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:25 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 1073741824 Jul 08 11:36:25 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a26f5f-4c32-42a1-91ec-38a3687864d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:25 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Volume volume-53a025f0-b4fa-4003-bc98-349ad7a5894a (53a025f0-b4fa-4003-bc98-349ad7a5894a): created successfully Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a26f5f-4c32-42a1-91ec-38a3687864d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (886cfd70-0e22-462f-aff0-026133c88ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-decf9acc-37a3-478b-8235-3cd41b5f09f2 tempest-CreateVolumesFromImageTest-1304654659 None] Created volume successfully. Jul 08 11:36:25 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97" returned: 0 in 0.862s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a050a-8350-4fba-94a0-18c78b58506a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:25 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e Jul 08 11:36:25 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:26 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 1073741824" returned: 0 in 0.856s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:26 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 Jul 08 11:36:26 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:26 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:26 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 Jul 08 11:36:26 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:27 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.950s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea229e8f-2126-435b-9b9f-d2aa3941e389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27e3eee-b3cd-4a61-9049-94843e5bac21', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5324ba63-62a1-400e-a748-b721c943fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Creating offline snapshot 95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 of volume 458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:36:27 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Volume volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 (a27e3eee-b3cd-4a61-9049-94843e5bac21): created successfully Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5324ba63-62a1-400e-a748-b721c943fc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (f7f4bdf4-f58e-47b6-8419-e57905395021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554353b-1e6d-4136-9983-ffa61d907786]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:27 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-6a40e616-0c2a-45f1-96af-6be94cdba57c tempest-CreateVolumesFromImageTest-1304654659 None] Created volume successfully. Jul 08 11:36:27 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae Jul 08 11:36:27 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:27 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97" returned: 0 in 0.817s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:27 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97 Jul 08 11:36:27 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:27 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae" returned: 0 in 0.790s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:27 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 1G Jul 08 11:36:27 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:28 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e.e73277d5-017a-4246-ba7d-367cb1e7ca97" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-e73277d5-017a-4246-ba7d-367cb1e7ca97" released by "_delete_snapshot" :: held 3.295s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" released by "delete_snapshot" :: held 3.325s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['576f0e2d-8100-4b51-b7c0-43f011d607da', 'a01da51f-473a-40c1-aab8-38870a0955a7', '78cd3235-d099-4a07-85f4-36a1d020e596', '4f20140b-a13e-443f-9ba2-90433ccfd7c4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Delete snapshot completed successfully. Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0b6ce9b-b6ca-42b1-8047-ccf53f8603a7 tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-e73277d5-017a-4246-ba7d-367cb1e7ca97-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:28 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 1G" returned: 0 in 0.859s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458d3d51-23ad-4398-818f-299a1d6714ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:28 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458d3d51-23ad-4398-818f-299a1d6714ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 Jul 08 11:36:28 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-ef83d87c-aed3-4ed5-9b61-91921e137e1e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-ef83d87c-aed3-4ed5-9b61-91921e137e1e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[57738db5-d31f-4f91-b366-7df8e8227f74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:29 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e Jul 08 11:36:29 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:29 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-458d3d51-23ad-4398-818f-299a1d6714ae -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:29 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 is being set with open permissions: ugo+rw Jul 08 11:36:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:29 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 Jul 08 11:36:29 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:29 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e" returned: 0 in 0.797s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:30 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e Jul 08 11:36:30 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:30 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" returned: 0 in 0.673s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:30 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info Jul 08 11:36:30 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:30 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ef83d87c-aed3-4ed5-9b61-91921e137e1e" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-quobyte-ef83d87c-aed3-4ed5-9b61-91921e137e1e" released by "delete_volume" :: held 1.588s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Created reservations ['4cf116ac-e95c-4bb3-9c61-d95eaf17feb8', '33299434-f81e-4b0a-a8f7-9173c65cfefc', 'e91ed773-a173-425a-a6ac-7ba6f564a95b', '86b72a72-1832-4d4a-892f-7816aec0d986'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:30 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:30 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:30 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:30 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info is being set with open permissions: ugo+rw Jul 08 11:36:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:30 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info Jul 08 11:36:30 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:31 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.info" returned: 0 in 0.744s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:31 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.156s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-289453926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab99f37-83ce-4484-b182-6ab74b5c78df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cffa0154da4f889bdb0baa67a6eead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:21Z,use_quota=True,user_id='3cc22250545d47b0bdd260fa8d298cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Creating volume 5ab99f37-83ce-4484-b182-6ab74b5c78df {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:31 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.859s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Deleted volume successfully. Jul 08 11:36:31 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df 1073741824 Jul 08 11:36:31 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-011113b3-132b-4d14-9fc9-c3172261bcb5 tempest-CinderUnicodeTest-384901371 None] Create snapshot completed successfully Jul 08 11:36:31 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-52256258-1486-4b5e-8574-603d328baa6a tempest-CreateVolumesFromSnapshotTest-481869430 None] Lock "cinder-ef83d87c-aed3-4ed5-9b61-91921e137e1e-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-quobyte-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Deleting offline snapshot 95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 of volume 458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] snapshot_file for this snap is: volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed7f8a-9eb6-4d7c-8a06-e6b7dfd9052a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:32 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 Jul 08 11:36:32 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:32 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df 1073741824" returned: 0 in 1.161s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:32 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df Jul 08 11:36:32 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:33 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" returned: 0 in 0.978s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-458d3d51-23ad-4398-818f-299a1d6714ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08c3e2-4822-4472-9e71-a941b28969c0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:33 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df" returned: 0 in 0.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccc3c13-0820-4901-aa58-e676aa3db20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab99f37-83ce-4484-b182-6ab74b5c78df', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4022f65-3e07-4326-bd75-d082e5bd5d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:33 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Volume volume-5ab99f37-83ce-4484-b182-6ab74b5c78df (5ab99f37-83ce-4484-b182-6ab74b5c78df): created successfully Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4022f65-3e07-4326-bd75-d082e5bd5d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:33 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae Jul 08 11:36:33 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Flow 'volume_create_manager' (4ba30694-efd6-4512-909f-c9c3d9906044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c5bd4d0a-25e7-49b0-82f6-b921d6bb2c53 tempest-CreateVolumesFromImageTest-1304654659 None] Created volume successfully. Jul 08 11:36:34 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae" returned: 0 in 0.798s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:34 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 Jul 08 11:36:34 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-5ab99f37-83ce-4484-b182-6ab74b5c78df-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-5ab99f37-83ce-4484-b182-6ab74b5c78df-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-quobyte-5ab99f37-83ce-4484-b182-6ab74b5c78df" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-5ab99f37-83ce-4484-b182-6ab74b5c78df" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Flow 'volume_create_manager' (5c7cec27-ad8d-4c72-abe7-f378c3e550ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b128729-7158-4bc1-9088-0873883e2d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f920bb4-a2b4-4999-b6c4-0f6312a9cad4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b128729-7158-4bc1-9088-0873883e2d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204401565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ac799d-e8ec-4d90-b30d-e05e9427fa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590fffbc46b74e6194a3e811fba3082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:35Z,use_quota=True,user_id='dde4fc8240eb430797c385a0d366197e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15654900-9a77-46b3-a737-5ba4f4d54594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15654900-9a77-46b3-a737-5ba4f4d54594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa5d39d-3998-4a65-9a5d-d4adb694209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa5d39d-3998-4a65-9a5d-d4adb694209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ac799d-e8ec-4d90-b30d-e05e9427fa63', 'volume_name': 'volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb21221-f9e8-43a5-8679-48a9a602cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:34 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb21221-f9e8-43a5-8679-48a9a602cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b8145c-b67a-4f82-93e9-1392319d753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:35 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Volume c8ac799d-e8ec-4d90-b30d-e05e9427fa63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63', 'volume_size': 1} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204401565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ac799d-e8ec-4d90-b30d-e05e9427fa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590fffbc46b74e6194a3e811fba3082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:35Z,use_quota=True,user_id='dde4fc8240eb430797c385a0d366197e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Creating volume c8ac799d-e8ec-4d90-b30d-e05e9427fa63 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:35 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:35 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 1073741824 Jul 08 11:36:35 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:35 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df Jul 08 11:36:35 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:35 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" returned: 0 in 0.946s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:35 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1 Jul 08 11:36:35 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:35 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df" returned: 0 in 1.017s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:35 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df Jul 08 11:36:35 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:36 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 1073741824" returned: 0 in 1.084s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:36 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 Jul 08 11:36:36 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:36 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae.95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" returned: 0 in 0.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1" released by "_delete_snapshot" :: held 3.698s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" released by "delete_snapshot" :: held 3.738s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Created reservations ['bb9b558b-868f-4e89-ae1a-b3c0b30b478e', '7b121781-435d-476e-91a3-e415ee92fe7a', '6bacab40-1a48-4046-8fea-2d6fea5d8f6f', '0dee4e6b-43f5-44c4-95e8-8684bf585ea5'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:36 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Delete snapshot completed successfully. Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5aa6ef34-fdc4-41db-a659-cb29b43f2b83 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-95b2e7c8-a6b9-44f8-87aa-3ae76881eaf1-delete_snapshot" released by "delete_snapshot" :: held 3.900s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:36 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5ab99f37-83ce-4484-b182-6ab74b5c78df" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-5ab99f37-83ce-4484-b182-6ab74b5c78df" released by "delete_volume" :: held 1.792s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Created reservations ['fcaa0807-9cb5-4613-94f9-573c4ab0b25b', '6726edfa-f19f-4f2b-b71d-b3416275b198', 'a200a1b7-abb6-4030-b697-6b90ceb61c1d', 'de2bcf84-ca4b-441e-8d85-862e30ce6d64'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:36 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:36 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:36 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" returned: 0 in 0.762s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-458d3d51-23ad-4398-818f-299a1d6714ae-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b8145c-b67a-4f82-93e9-1392319d753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd378d9c-27b2-4577-b344-ffc8617c874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-458d3d51-23ad-4398-818f-299a1d6714ae-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:37 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Volume volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 (c8ac799d-e8ec-4d90-b30d-e05e9427fa63): created successfully Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd378d9c-27b2-4577-b344-ffc8617c874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Flow 'volume_create_manager' (5c7cec27-ad8d-4c72-abe7-f378c3e550ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-a27e3eee-b3cd-4a61-9049-94843e5bac21-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8d904654-ce2c-41b1-ad8f-aba416897c69 tempest-ProjectReaderTests-1230062346 None] Created volume successfully. Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-a27e3eee-b3cd-4a61-9049-94843e5bac21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" acquired by "delete_volume" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-quobyte-a27e3eee-b3cd-4a61-9049-94843e5bac21" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a005e-7a33-4cb4-a895-b78715f88a39]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-a27e3eee-b3cd-4a61-9049-94843e5bac21" acquired by "delete_volume" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f9d02-2028-405a-8a5a-a5289988a113]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:37 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae Jul 08 11:36:37 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:37 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 Jul 08 11:36:37 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:37 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.827s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Deleted volume successfully. Jul 08 11:36:37 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1613cc5f-e1c4-442a-86f1-d879b3c05692 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-5ab99f37-83ce-4484-b182-6ab74b5c78df-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:38 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae" returned: 0 in 0.889s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:38 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae Jul 08 11:36:38 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:38 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21" returned: 0 in 0.981s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:38 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21 Jul 08 11:36:38 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Acquiring lock "cinder-c8ac799d-e8ec-4d90-b30d-e05e9427fa63-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "cinder-c8ac799d-e8ec-4d90-b30d-e05e9427fa63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=158,cinder:UPDATE=197,cinder:DELETE=18,cinder:INSERT=46 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Acquiring lock "cinder-quobyte-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "cinder-quobyte-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" acquired by "delete_volume" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70ff4c5-c727-4285-9a62-380f8026cb48]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:38 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 Jul 08 11:36:38 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:38 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-458d3d51-23ad-4398-818f-299a1d6714ae" returned: 0 in 0.743s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-458d3d51-23ad-4398-818f-299a1d6714ae" released by "delete_volume" :: held 1.715s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Created reservations ['56959d1c-26dc-4d7d-b8f6-a34cdac0a4fe', 'fca16c58-4f02-4418-844f-94df465c14a0', '02476df6-9a7a-450f-b8c7-08b27e620f18', 'bf2334ec-0871-4997-8692-a58bcc582036'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:38 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-a27e3eee-b3cd-4a61-9049-94843e5bac21" returned: 0 in 0.782s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:39 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:39 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-a27e3eee-b3cd-4a61-9049-94843e5bac21" released by "delete_volume" :: held 1.831s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:UPDATE=220,cinder:SELECT=151,cinder:INSERT=69,cinder:DELETE=21 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Created reservations ['d5169d0a-3d7f-4396-b11b-2171d8805272', 'fe19b0f3-afce-41e7-ac10-ba91efd2e699', '9a488030-5ba4-4814-a57f-9bf659fc35cf', 'e3ed5f16-a8ba-47df-9b09-45c8124013e3'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-6f743c09-8a93-4534-841c-84022658517c-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-6f743c09-8a93-4534-841c-84022658517c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:39 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:39 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "cinder-quobyte-6f743c09-8a93-4534-841c-84022658517c" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-53a025f0-b4fa-4003-bc98-349ad7a5894a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-6f743c09-8a93-4534-841c-84022658517c" acquired by "delete_volume" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-53a025f0-b4fa-4003-bc98-349ad7a5894a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[da611ebe-f4e5-4c5f-ac97-1e54856c9c60]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-quobyte-53a025f0-b4fa-4003-bc98-349ad7a5894a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:39 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-53a025f0-b4fa-4003-bc98-349ad7a5894a" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" returned: 0 in 1.129s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0bfa21-1b90-4d49-9680-932b2a976967]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:39 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63 Jul 08 11:36:39 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:39 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c Jul 08 11:36:39 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:39 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a Jul 08 11:36:39 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:40 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.289s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Deleted volume successfully. Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0375e536-45bd-4050-ae2d-f2c043f1c7a8 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-458d3d51-23ad-4398-818f-299a1d6714ae-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:40 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c" returned: 0 in 0.991s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:40 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c Jul 08 11:36:40 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:40 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" returned: 0 in 1.121s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "cinder-quobyte-c8ac799d-e8ec-4d90-b30d-e05e9427fa63" released by "delete_volume" :: held 2.298s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:40 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.456s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Deleted volume successfully. Jul 08 11:36:40 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8cc0c5fe-1de7-4bff-b62d-e5ef87bf074e tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-a27e3eee-b3cd-4a61-9049-94843e5bac21-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a" returned: 0 in 1.192s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:40 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a Jul 08 11:36:40 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Created reservations ['326e790f-1d24-4d0f-8cce-0e0f13cd0a45', 'd7bd9a55-baa0-4dfe-a3ff-77d530dce1ab', '56037338-c737-4916-b049-d007a15190cb', 'f5bd05d2-a6af-48af-985a-858691337ce7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:40 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:40 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:41 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6f743c09-8a93-4534-841c-84022658517c" returned: 0 in 0.871s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-quobyte-6f743c09-8a93-4534-841c-84022658517c" released by "delete_volume" :: held 1.941s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Created reservations ['be3a0c27-017f-4ac5-8340-0c57634b2285', '58642f7f-c5fe-46e1-ba76-0ad0069d07c9', 'ba8aaba0-37b0-4623-ad04-0b5da527fd95', 'afa45f15-7ba8-4d9d-b4c6-0419d7c7d17d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:41 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:41 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:41 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-53a025f0-b4fa-4003-bc98-349ad7a5894a" returned: 0 in 0.867s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-53a025f0-b4fa-4003-bc98-349ad7a5894a" released by "delete_volume" :: held 2.189s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:41 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (5c1f75c0-c3e7-4265-96ae-563dac87709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be9f52d-acd1-4696-bbc6-e5a6cf0c5f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.915s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be9f52d-acd1-4696-bbc6-e5a6cf0c5f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118483995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecda72fc-c02b-470d-b7f4-d8c23f269178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:42Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26bd062-e6c5-4386-8387-7463142068a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26bd062-e6c5-4386-8387-7463142068a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd66fdf-c466-42a6-bbdd-efc6c0c0e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd66fdf-c466-42a6-bbdd-efc6c0c0e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecda72fc-c02b-470d-b7f4-d8c23f269178', 'volume_name': 'volume-ecda72fc-c02b-470d-b7f4-d8c23f269178', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45a188f-b9d7-4677-bfe5-25b53615157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45a188f-b9d7-4677-bfe5-25b53615157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc188b-7d27-4922-a4b2-bc60ab46a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:41 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Volume ecda72fc-c02b-470d-b7f4-d8c23f269178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecda72fc-c02b-470d-b7f4-d8c23f269178', 'volume_size': 1} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118483995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecda72fc-c02b-470d-b7f4-d8c23f269178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:42Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Creating volume ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:41 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 1073741824 Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:42 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Deleted volume successfully. Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-dc6dc891-138f-4304-af92-f5c77c23632f tempest-ProjectReaderTests-1230062346 None] Lock "cinder-c8ac799d-e8ec-4d90-b30d-e05e9427fa63-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Created reservations ['2e7cb2b7-a7a2-4e55-8f99-2e8ce9e93f9f', 'f1894fe0-458a-4c7e-86cc-598a9657ea7b', 'b41ead14-0d0c-4f1d-b965-6b46bcfe2570', '0bebc946-db71-4ef9-b4c4-2445369473b3'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:41 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:42 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:42 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Flow 'volume_create_manager' (f86b468e-050d-4b07-82b5-cea12223551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff48714-108c-48d3-adb0-31f4ea23cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff48714-108c-48d3-adb0-31f4ea23cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771148342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44e40e9-2b30-468d-9755-4ba3df6b9131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590fffbc46b74e6194a3e811fba3082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:42Z,use_quota=True,user_id='dde4fc8240eb430797c385a0d366197e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15faf2d-dfee-4415-a136-8949f1cec585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15faf2d-dfee-4415-a136-8949f1cec585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78889c7-a2be-4e24-bfd6-3e90378c1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78889c7-a2be-4e24-bfd6-3e90378c1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44e40e9-2b30-468d-9755-4ba3df6b9131', 'volume_name': 'volume-f44e40e9-2b30-468d-9755-4ba3df6b9131', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2076ce7-1bfa-4040-aed3-27350c7f9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2076ce7-1bfa-4040-aed3-27350c7f9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a9578d-a2a5-416e-97a0-1c2c7182a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:42 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Volume f44e40e9-2b30-468d-9755-4ba3df6b9131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44e40e9-2b30-468d-9755-4ba3df6b9131', 'volume_size': 1} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-c4213054-8fb2-4cf0-88e3-c900fa3f9d72-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:42 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-c4213054-8fb2-4cf0-88e3-c900fa3f9d72-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 1.347s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Deleted volume successfully. Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-quobyte-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4100fe74-d219-489d-b00b-6104475ac0b6 tempest-CinderUnicodeTest-384901371 None] Lock "cinder-6f743c09-8a93-4534-841c-84022658517c-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725084f-c03a-4aa0-b771-547550ba257c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:43 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.966s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:43 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Deleted volume successfully. Jul 08 11:36:43 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 Jul 08 11:36:43 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f6a89df4-a17c-41d1-a08a-3172073529b2 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-53a025f0-b4fa-4003-bc98-349ad7a5894a-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:43 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 1073741824" returned: 0 in 1.297s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:43 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 Jul 08 11:36:43 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:43 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" returned: 0 in 0.812s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:43 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72 Jul 08 11:36:43 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:43 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178" returned: 0 in 0.722s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771148342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44e40e9-2b30-468d-9755-4ba3df6b9131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590fffbc46b74e6194a3e811fba3082b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:42Z,use_quota=True,user_id='dde4fc8240eb430797c385a0d366197e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Creating volume f44e40e9-2b30-468d-9755-4ba3df6b9131 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:44 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc188b-7d27-4922-a4b2-bc60ab46a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecda72fc-c02b-470d-b7f4-d8c23f269178', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:44 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 1073741824 Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1fead-3fcf-4cd1-935a-0c9cfc24d153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:44 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:44 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Volume volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 (ecda72fc-c02b-470d-b7f4-d8c23f269178): created successfully Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1fead-3fcf-4cd1-935a-0c9cfc24d153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (5c1f75c0-c3e7-4265-96ae-563dac87709f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-53e905db-e429-48e5-a8e5-43f8144ca6c9 tempest-ProjectReaderTests-993732665 None] Created volume successfully. Jul 08 11:36:44 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-c4213054-8fb2-4cf0-88e3-c900fa3f9d72" released by "delete_volume" :: held 1.548s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Created reservations ['0d5a509c-96ed-42ff-b372-bdc745a254bf', 'b2bf652a-d4d8-4293-b2b5-2bdf69a5e9b7', '37e72591-0f72-42f2-9794-f21d22a58c02', '3623a499-a84e-460e-9851-f2948c08f396'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:44 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:44 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:45 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 1073741824" returned: 0 in 1.085s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:45 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 Jul 08 11:36:45 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-2b5fce44-c751-4c8e-9367-42239f7e634d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-2b5fce44-c751-4c8e-9367-42239f7e634d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "cinder-quobyte-2b5fce44-c751-4c8e-9367-42239f7e634d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-2b5fce44-c751-4c8e-9367-42239f7e634d" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5a6c8-cc0f-468f-9321-571e44b0496d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:45 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d Jul 08 11:36:45 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:45 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.913s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:45 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Deleted volume successfully. Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ffcd5104-c017-4626-8bf4-5f3de8e52bfc tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-c4213054-8fb2-4cf0-88e3-c900fa3f9d72-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:45 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131" returned: 0 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a9578d-a2a5-416e-97a0-1c2c7182a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44e40e9-2b30-468d-9755-4ba3df6b9131', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237ec34f-0575-4746-8e7c-b7d1b828cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Creating offline snapshot b83f6628-da63-4f5e-9268-4ff58ee57654 of volume ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:36:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Volume volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 (f44e40e9-2b30-468d-9755-4ba3df6b9131): created successfully Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237ec34f-0575-4746-8e7c-b7d1b828cd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Flow 'volume_create_manager' (f86b468e-050d-4b07-82b5-cea12223551b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a443b08-a26a-42b3-a163-bad03c41c29a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-7cf4475b-872b-414d-92f2-36a8cc73c9ad tempest-ProjectReaderTests-1230062346 None] Created volume successfully. Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (cc9fbf01-c971-4ea6-8fde-dee79b9f7adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236a65e7-b73b-4696-a613-74c63957b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236a65e7-b73b-4696-a613-74c63957b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294270967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69687e65-ac0c-4d08-8b39-23fd5e3ff6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:46Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:46 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 Jul 08 11:36:46 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfcc06f-fd36-498f-b146-caa2ef17ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfcc06f-fd36-498f-b146-caa2ef17ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d918b-ecbd-4eb3-b009-967d51247e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d918b-ecbd-4eb3-b009-967d51247e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69687e65-ac0c-4d08-8b39-23fd5e3ff6cf', 'volume_name': 'volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5177bb-41fc-412f-9a87-ea764c092c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5177bb-41fc-412f-9a87-ea764c092c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99619b85-e521-4bcc-8e58-6caf106ae307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:46 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Volume 69687e65-ac0c-4d08-8b39-23fd5e3ff6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf', 'volume_size': 1} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:46 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d" returned: 0 in 0.837s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:46 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d Jul 08 11:36:46 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Acquiring lock "cinder-f44e40e9-2b30-468d-9755-4ba3df6b9131-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "cinder-f44e40e9-2b30-468d-9755-4ba3df6b9131-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Acquiring lock "cinder-quobyte-f44e40e9-2b30-468d-9755-4ba3df6b9131" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "cinder-quobyte-f44e40e9-2b30-468d-9755-4ba3df6b9131" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb991ad5-c09b-4691-a8a3-b6b7173bf0e5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:46 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178" returned: 0 in 0.856s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:46 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 1G Jul 08 11:36:46 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:46 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2b5fce44-c751-4c8e-9367-42239f7e634d" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-quobyte-2b5fce44-c751-4c8e-9367-42239f7e634d" released by "delete_volume" :: held 1.536s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:46 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 Jul 08 11:36:46 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Created reservations ['22c20699-caa2-4d0a-84bd-8cfe4992f79e', '04f21cef-0f3b-4489-aabf-0524a0feb901', 'cf17fae1-70f6-4cfd-8519-f409045cd9f1', '953156d6-bae9-4832-b0ff-f4a749d8706f'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:47 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:47 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:47 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:47 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131 Jul 08 11:36:47 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:47 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 1G" returned: 0 in 0.877s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:47 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 Jul 08 11:36:47 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:47 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.752s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Deleted volume successfully. Jul 08 11:36:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f896f52a-58c5-4db4-8255-3f51ba8e2653 tempest-CreateVolumesFromImageTest-1304654659 None] Lock "cinder-2b5fce44-c751-4c8e-9367-42239f7e634d-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:48 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f44e40e9-2b30-468d-9755-4ba3df6b9131" returned: 0 in 0.751s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "cinder-quobyte-f44e40e9-2b30-468d-9755-4ba3df6b9131" released by "delete_volume" :: held 1.625s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Created reservations ['cb8dec52-e740-4fdd-a253-6bdb6b5f5822', '972ff77b-9d22-457d-831d-6cf5cf619af3', 'a26b6361-972c-43d2-98e6-c5de4a9a36f1', 'faac0399-80cd-4048-81fb-d840d4ac6bcd'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:48 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654" returned: 0 in 0.832s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:48 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 is being set with open permissions: ugo+rw Jul 08 11:36:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:48 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:48 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:48 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 Jul 08 11:36:48 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:49 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.777s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:49 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:49 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Deleted volume successfully. Jul 08 11:36:49 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654" returned: 0 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:49 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8995b817-ae64-4297-be45-aa2af19fdf5a tempest-ProjectReaderTests-1230062346 None] Lock "cinder-f44e40e9-2b30-468d-9755-4ba3df6b9131-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:49 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info Jul 08 11:36:49 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:50 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info" returned: 0 in 0.684s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:50 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info is being set with open permissions: ugo+rw Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:50 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info Jul 08 11:36:50 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:50 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.info" returned: 0 in 0.697s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.619s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294270967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69687e65-ac0c-4d08-8b39-23fd5e3ff6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:46Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Creating volume 69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:50 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:50 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf 1073741824 Jul 08 11:36:50 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-dc0d0305-29f7-43d3-9df5-5c08f6f99a30 tempest-ProjectReaderTests-993732665 None] Create snapshot completed successfully Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Flow 'volume_create_manager' (9fc4595d-5293-43d5-bc43-dcef069d4862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd120408-1c80-428f-a8f7-f9f06e65d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd120408-1c80-428f-a8f7-f9f06e65d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1756333890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657a140-a0f1-4322-8e45-75aa8fe64aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea09a8d0b0a4d9891114e270e481804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:51Z,use_quota=True,user_id='8456500079f24d979618505cd2b79e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e314f9-8ab6-4a82-8cea-299db818c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e314f9-8ab6-4a82-8cea-299db818c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215b865f-e3cd-4bbe-8416-5c458d1609c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215b865f-e3cd-4bbe-8416-5c458d1609c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4657a140-a0f1-4322-8e45-75aa8fe64aff', 'volume_name': 'volume-4657a140-a0f1-4322-8e45-75aa8fe64aff', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4bea25-2acb-4785-984d-fdabc0ec4a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4bea25-2acb-4785-984d-fdabc0ec4a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c3f858-41df-4ea7-8cff-a3931b3dcf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Volume 4657a140-a0f1-4322-8e45-75aa8fe64aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4657a140-a0f1-4322-8e45-75aa8fe64aff', 'volume_size': 1} Jul 08 11:36:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-b83f6628-da63-4f5e-9268-4ff58ee57654-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-b83f6628-da63-4f5e-9268-4ff58ee57654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-b83f6628-da63-4f5e-9268-4ff58ee57654" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-b83f6628-da63-4f5e-9268-4ff58ee57654" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Deleting offline snapshot b83f6628-da63-4f5e-9268-4ff58ee57654 of volume ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:36:51 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] snapshot_file for this snap is: volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf 1073741824" returned: 0 in 0.934s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbb0d8-1e3a-43d3-b65a-dc5f6a15f6e2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:51 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf Jul 08 11:36:51 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:51 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 Jul 08 11:36:51 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:52 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:52 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:52 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" returned: 0 in 0.667s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1756333890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657a140-a0f1-4322-8e45-75aa8fe64aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea09a8d0b0a4d9891114e270e481804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:51Z,use_quota=True,user_id='8456500079f24d979618505cd2b79e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Creating volume 4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:36:52 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:52 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff 1073741824 Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99619b85-e521-4bcc-8e58-6caf106ae307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:52 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc7c447-799a-481c-8242-fb036aca93ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:52 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Volume volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf (69687e65-ac0c-4d08-8b39-23fd5e3ff6cf): created successfully Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc7c447-799a-481c-8242-fb036aca93ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (cc9fbf01-c971-4ea6-8fde-dee79b9f7adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9966f4fb-b262-455b-8162-e44398668996 tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:36:52 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654" returned: 0 in 0.898s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecda72fc-c02b-470d-b7f4-d8c23f269178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ab9bb-262c-421d-a69c-1c14984cdee1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:52 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 Jul 08 11:36:52 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:53 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.798s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:36:53 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff 1073741824" returned: 0 in 1.053s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:53 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178" returned: 0 in 0.897s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:53 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:36:53 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:53 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 Jul 08 11:36:53 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:54 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.205s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c3f858-41df-4ea7-8cff-a3931b3dcf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4657a140-a0f1-4322-8e45-75aa8fe64aff', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea79838-c42a-44d7-a76e-bc0796aa0ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Creating offline snapshot cfc8aa64-36f1-4dec-96b6-6c4397b068e8 of volume 69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:36:54 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Volume volume-4657a140-a0f1-4322-8e45-75aa8fe64aff (4657a140-a0f1-4322-8e45-75aa8fe64aff): created successfully Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea79838-c42a-44d7-a76e-bc0796aa0ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Flow 'volume_create_manager' (9fc4595d-5293-43d5-bc43-dcef069d4862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a00079-99ee-44e9-97de-3199c8e49eb0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:54 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9e1f981b-2566-45de-97a1-b3d34c8219a1 tempest-VolumeDependencyTests-728541794 None] Created volume successfully. Jul 08 11:36:54 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf Jul 08 11:36:54 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:54 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654" returned: 0 in 0.880s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:54 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654 Jul 08 11:36:54 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:55 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" returned: 0 in 0.813s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:55 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178.b83f6628-da63-4f5e-9268-4ff58ee57654" returned: 0 in 0.705s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:55 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 1G Jul 08 11:36:55 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-b83f6628-da63-4f5e-9268-4ff58ee57654" released by "_delete_snapshot" :: held 3.517s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" released by "delete_snapshot" :: held 3.546s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Created reservations ['e558652b-b0f3-4a16-ae19-01d8fab63fdc', '3760c5d8-bdf7-400c-9e94-2ae409c3e905', 'fbd44144-5d59-4f88-ba56-13e9a213001c', '8b96826f-8a27-4c07-8cbe-f387aa600f32'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Delete snapshot completed successfully. Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e1b17e17-6981-4c79-a11e-7c32e0b22108 tempest-ProjectReaderTests-993732665 None] Lock "cinder-b83f6628-da63-4f5e-9268-4ff58ee57654-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-ecda72fc-c02b-470d-b7f4-d8c23f269178-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:55 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "cinder-ecda72fc-c02b-470d-b7f4-d8c23f269178-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52d812-e1b3-4e78-87ee-355457398621]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:56 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 1G" returned: 0 in 1.019s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:56 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 Jul 08 11:36:56 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:56 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 Jul 08 11:36:56 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:56 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:56 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8" returned: 0 in 0.744s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:56 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 is being set with open permissions: ugo+rw Jul 08 11:36:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:56 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178 Jul 08 11:36:56 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:56 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 Jul 08 11:36:56 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:57 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:57 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ecda72fc-c02b-470d-b7f4-d8c23f269178" returned: 0 in 0.715s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ecda72fc-c02b-470d-b7f4-d8c23f269178" released by "delete_volume" :: held 1.596s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:57 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info Jul 08 11:36:57 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Created reservations ['2de1f1b6-4fd9-44e2-98e1-d1a5dc41750e', 'de04d10d-a2c4-4f4e-a4fb-852e19cfc4a3', '785740dd-80f5-4e71-a9e3-10dcacc8554c', '9ccb128c-a435-4fd0-a87e-fec8f84df94d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:57 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:36:57 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:58 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info" returned: 0 in 0.754s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:58 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info is being set with open permissions: ugo+rw Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:58 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info Jul 08 11:36:58 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (5958739f-0e70-4f6e-93f7-fdb1b963ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea72adb-bf04-4c3f-b3fa-0589fa584e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea72adb-bf04-4c3f-b3fa-0589fa584e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016842852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e695e48-f0d1-4cde-963c-8d1a38f8a664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:58Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb73373-beaa-412c-93f6-918fcc1c8ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb73373-beaa-412c-93f6-918fcc1c8ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf52a2-01f0-417c-bf1d-2210dbca2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbf52a2-01f0-417c-bf1d-2210dbca2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e695e48-f0d1-4cde-963c-8d1a38f8a664', 'volume_name': 'volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dd4c86-5d1f-4048-b231-e5ed190228a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dd4c86-5d1f-4048-b231-e5ed190228a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312c5114-382c-43e3-a4cd-27d9073b3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Volume 3e695e48-f0d1-4cde-963c-8d1a38f8a664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664', 'volume_size': 1} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.831s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:36:58 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Deleted volume successfully. Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0f2356bd-35ec-40ac-9fb6-03df3167bceb tempest-ProjectReaderTests-993732665 None] Lock "cinder-ecda72fc-c02b-470d-b7f4-d8c23f269178-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (0c7cce92-dcbb-44b0-a319-a0c90aa2d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d14a904-b437-4049-b47e-ce8d90b1e89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d14a904-b437-4049-b47e-ce8d90b1e89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71850564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc67640-fed0-4c77-b572-611a64920529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:59Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5078e77a-2b3e-413a-a01a-9ecb28d25f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5078e77a-2b3e-413a-a01a-9ecb28d25f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79be0236-a22b-4462-86cd-a30a9b6a06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79be0236-a22b-4462-86cd-a30a9b6a06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc67640-fed0-4c77-b572-611a64920529', 'volume_name': 'volume-edc67640-fed0-4c77-b572-611a64920529', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddfd2cc-9f8e-4620-ba10-7db69b2b6453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddfd2cc-9f8e-4620-ba10-7db69b2b6453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd962c5a-e7ea-45d1-a067-d6f6c82c1b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:36:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Volume edc67640-fed0-4c77-b572-611a64920529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc67640-fed0-4c77-b572-611a64920529', 'volume_size': 1} Jul 08 11:36:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:36:59 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.info" returned: 0 in 0.715s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.769s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Creating offline snapshot 1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 of volume 4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:36:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b893cf3b-0224-4acf-b13d-11d0c9a1a1fa tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0909a1ec-6323-46e0-a1f6-4eeb96da43ae]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-cfc8aa64-36f1-4dec-96b6-6c4397b068e8-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:59 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:36:59 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-cfc8aa64-36f1-4dec-96b6-6c4397b068e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-cfc8aa64-36f1-4dec-96b6-6c4397b068e8" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cfc8aa64-36f1-4dec-96b6-6c4397b068e8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot cfc8aa64-36f1-4dec-96b6-6c4397b068e8 of volume 69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b2743c-c08d-45ab-80f1-d8aaad16dfc6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:36:59 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 Jul 08 11:36:59 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:36:59 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:36:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:00 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 1G Jul 08 11:37:00 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:00 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8" returned: 0 in 0.764s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff5deb2-115a-452a-8f51-d1056e7d615f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:00 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf Jul 08 11:37:00 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:00 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 1G" returned: 0 in 0.787s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4657a140-a0f1-4322-8e45-75aa8fe64aff -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:00 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4657a140-a0f1-4322-8e45-75aa8fe64aff -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:00 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:00 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" returned: 0 in 0.751s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:00 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 Jul 08 11:37:00 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:01 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4657a140-a0f1-4322-8e45-75aa8fe64aff -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:01 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 is being set with open permissions: ugo+rw Jul 08 11:37:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:01 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:01 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:01 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8" returned: 0 in 0.751s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:01 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8 Jul 08 11:37:01 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:02 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.652s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:02 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info Jul 08 11:37:02 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:02 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf.cfc8aa64-36f1-4dec-96b6-6c4397b068e8" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cfc8aa64-36f1-4dec-96b6-6c4397b068e8" released by "_delete_snapshot" :: held 3.021s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" released by "delete_snapshot" :: held 3.050s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Created reservations ['385c7f0a-0a7f-4b42-b46c-677e6f3ab6de', 'bdef1e13-ff92-4aca-b517-2a3a25628e27', '2d5a08d9-5fb1-4241-aef8-6ebeb3ff6409', '45d90cd4-2bdc-43eb-a9bc-59e160567ea4'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0b9e071c-814c-40c0-9277-f8f42faa209e tempest-ProjectMemberTests-872509998 None] Lock "cinder-cfc8aa64-36f1-4dec-96b6-6c4397b068e8-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:02 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info" returned: 0 in 0.672s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:02 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info is being set with open permissions: ugo+rw Jul 08 11:37:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:02 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info Jul 08 11:37:02 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:03 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.info" returned: 0 in 0.643s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.325s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.867s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016842852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e695e48-f0d1-4cde-963c-8d1a38f8a664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:58Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Creating volume 3e695e48-f0d1-4cde-963c-8d1a38f8a664 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:03 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:03 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 1073741824 Jul 08 11:37:03 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:03 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ff837dec-26a1-4bda-a70f-0c2a66ac70fa tempest-VolumeDependencyTests-728541794 None] Create snapshot completed successfully Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "cinder-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" acquired by "delete_volume" :: waited 0.029s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b3acda-8b0a-4159-89a6-84b798d34e6e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:03 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf Jul 08 11:37:03 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Flow 'volume_create_manager' (ec5c4006-2ff0-4b36-8777-d78f8c81068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1730483f-1bcc-4b4c-9a4a-56abc7f1dcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1730483f-1bcc-4b4c-9a4a-56abc7f1dcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-913688747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cea09a8d0b0a4d9891114e270e481804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:04Z,use_quota=True,user_id='8456500079f24d979618505cd2b79e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b551c-73d0-4ef9-9618-4e8f4fd1c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46b551c-73d0-4ef9-9618-4e8f4fd1c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a662ea8c-109b-48d1-bc1b-f73386a2c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a662ea8c-109b-48d1-bc1b-f73386a2c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef', 'volume_name': 'volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef', 'volume_size': 1, 'snapshot_id': '1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:04 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4941cf5a-f921-444e-9241-7d1b2b5129bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4941cf5a-f921-444e-9241-7d1b2b5129bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9395bf-2402-4fc3-9e81-fcb57a974b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Volume bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef', 'volume_size': 1, 'snapshot_id': '1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7'} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 1073741824" returned: 0 in 0.912s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:04 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 Jul 08 11:37:04 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:04 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" returned: 0 in 0.821s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:04 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf Jul 08 11:37:04 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:05 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664" returned: 0 in 0.706s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:05 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.310s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71850564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc67640-fed0-4c77-b572-611a64920529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:36:59Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Creating volume edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:05 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312c5114-382c-43e3-a4cd-27d9073b3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a92460f-2214-406f-a708-87c7b1e07044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:05 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 1073741824 Jul 08 11:37:05 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf" released by "delete_volume" :: held 1.576s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:05 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Volume volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 (3e695e48-f0d1-4cde-963c-8d1a38f8a664): created successfully Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a92460f-2214-406f-a708-87c7b1e07044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (5958739f-0e70-4f6e-93f7-fdb1b963ed60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:05 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0a0f1522-7f42-411b-a8f4-46c8f163244f tempest-ProjectReaderTests-1839377519 None] Created volume successfully. Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Created reservations ['8a5ca36a-b1f5-426b-ba83-e0cb5528bbf7', '92dc1dab-c85a-4646-b1ee-a399227c033d', '80eee485-af3b-4ba2-8f3e-9ceae7c4de8e', '5fd400bd-f8f4-484d-9c5d-92e4d8675cba'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:05 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:05 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:06 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-3e695e48-f0d1-4cde-963c-8d1a38f8a664-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:06 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 1073741824" returned: 0 in 0.916s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fcb1e671-0074-47b5-b7a1-b5d71ae16f8c tempest-ProjectMemberTests-872509998 None] Lock "cinder-69687e65-ac0c-4d08-8b39-23fd5e3ff6cf-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "cinder-3e695e48-f0d1-4cde-963c-8d1a38f8a664-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:06 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 Jul 08 11:37:06 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-quobyte-3e695e48-f0d1-4cde-963c-8d1a38f8a664" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-3e695e48-f0d1-4cde-963c-8d1a38f8a664" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa6eb3-89e0-4941-b31d-3131dd3c47f6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:06 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 Jul 08 11:37:06 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6c9bb0fa-61f7-4787-a3e9-40483c221d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6139d25-9fe8-47a3-8c32-861bc30dce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6139d25-9fe8-47a3-8c32-861bc30dce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003637724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1602555-861e-4618-b0b6-a5e5fceecf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:06Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e926fd0-02c9-4afe-8aa0-25c2ede966a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e926fd0-02c9-4afe-8aa0-25c2ede966a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54acfeea-580e-481d-a325-8c6ddb239ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54acfeea-580e-481d-a325-8c6ddb239ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1602555-861e-4618-b0b6-a5e5fceecf14', 'volume_name': 'volume-f1602555-861e-4618-b0b6-a5e5fceecf14', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc21780-8f90-4654-9bd1-04502d4cb3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc21780-8f90-4654-9bd1-04502d4cb3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d7bbe2-3ecd-4400-b69f-18b3692e4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Volume f1602555-861e-4618-b0b6-a5e5fceecf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1602555-861e-4618-b0b6-a5e5fceecf14', 'volume_size': 1} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:06 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529" returned: 0 in 0.705s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.430s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd962c5a-e7ea-45d1-a067-d6f6c82c1b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc67640-fed0-4c77-b572-611a64920529', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609dcbd-17f7-4afe-ba4c-b270d341b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Creating volume bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef from snapshot 1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Volume volume-edc67640-fed0-4c77-b572-611a64920529 (edc67640-fed0-4c77-b572-611a64920529): created successfully Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609dcbd-17f7-4afe-ba4c-b270d341b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (0c7cce92-dcbb-44b0-a319-a0c90aa2d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] snapshot: 1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7, volume: bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:37:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c0d4d29b-e948-4634-8264-f5df7ffe34bd tempest-ProjectReaderTests-993732665 None] Created volume successfully. Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:06 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cc61c2-3296-4cd5-bc3e-cdcef18025c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:07 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664" returned: 0 in 0.826s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:07 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664 Jul 08 11:37:07 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:07 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:07 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:07 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-3e695e48-f0d1-4cde-963c-8d1a38f8a664" returned: 0 in 0.728s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-3e695e48-f0d1-4cde-963c-8d1a38f8a664" released by "delete_volume" :: held 1.599s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:07 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.811s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4657a140-a0f1-4322-8e45-75aa8fe64aff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f9aa77-869b-4133-a9e1-172f9f7ebfac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Created reservations ['6b944c81-938c-49b3-b363-508832a1929f', '2b4d0cbf-5901-4bd7-92a4-ea1aa0815bb1', 'fbc117b7-e2b0-430b-9966-cb7b481454ad', '107f3462-5a17-4564-82f6-e9b145b83367'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:07 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:37:07 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:07 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:07 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:08 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.651s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Deleted volume successfully. Jul 08 11:37:08 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.782s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-709f295b-cfde-499d-9f1d-4cfd48a4956a tempest-ProjectReaderTests-1839377519 None] Lock "cinder-3e695e48-f0d1-4cde-963c-8d1a38f8a664-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:08 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef Jul 08 11:37:08 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (1c81c6c9-b614-4816-ae9e-e766fd6e690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd11a3d-84f2-4502-8471-82c53f5d96ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd11a3d-84f2-4502-8471-82c53f5d96ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230716876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6792d7-d088-4131-800b-27a28b0c1e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:09Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac17cc1-45e3-4938-9195-d78efd32a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac17cc1-45e3-4938-9195-d78efd32a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cc4cdd-d47d-4e58-ac5d-7a9d6fa041b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cc4cdd-d47d-4e58-ac5d-7a9d6fa041b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6792d7-d088-4131-800b-27a28b0c1e7a', 'volume_name': 'volume-ab6792d7-d088-4131-800b-27a28b0c1e7a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048ed9ac-13c0-4be7-ad0d-a56e474a2d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (048ed9ac-13c0-4be7-ad0d-a56e474a2d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3ab9ec-1354-42c2-be88-72fc146fb5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Volume ab6792d7-d088-4131-800b-27a28b0c1e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6792d7-d088-4131-800b-27a28b0c1e7a', 'volume_size': 1} Jul 08 11:37:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:13 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" returned: 0 in 4.575s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[310354a9-7d90-4448-9f9b-e72946bb774c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:13 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:37:13 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:14 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.892s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:37:14 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Converted 1024.00 MB image at 223.72 MB/s Jul 08 11:37:14 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef is being set with open permissions: ugo+rw Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:14 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef Jul 08 11:37:14 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:14 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" released by "_copy_volume_from_snapshot" :: held 7.805s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" released by "_create_volume_from_snapshot" :: held 7.860s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.901s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.265s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003637724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1602555-861e-4618-b0b6-a5e5fceecf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:06Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Creating volume f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:14 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:14 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 1073741824 Jul 08 11:37:14 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9395bf-2402-4fc3-9e81-fcb57a974b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef', 'volume_size': 1, 'snapshot_id': '1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0898614d-a4c1-4e16-81d1-8d6a2ff9f05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:14 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Volume volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef (bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef): created successfully Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0898614d-a4c1-4e16-81d1-8d6a2ff9f05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:14 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Flow 'volume_create_manager' (ec5c4006-2ff0-4b36-8777-d78f8c81068f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bb6dfb50-8fbf-453b-8b65-1980ffe98259 tempest-VolumeDependencyTests-728541794 None] Created volume successfully. Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Deleting offline snapshot 1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 of volume 4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] snapshot_file for this snap is: volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cc649a-877b-4b70-929b-e420b644712c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:15 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:15 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:15 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 1073741824" returned: 0 in 0.834s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:15 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 Jul 08 11:37:15 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:16 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4657a140-a0f1-4322-8e45-75aa8fe64aff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d237114-2d12-4c96-8720-203068c3d330]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:16 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:37:16 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:16 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.805s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d7bbe2-3ecd-4400-b69f-18b3692e4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1602555-861e-4618-b0b6-a5e5fceecf14', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012777f-8d85-4be8-8222-2e3f76da597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Creating offline snapshot cd173b1e-6f30-4ef9-8892-3d13f79664d1 of volume edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:16 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Volume volume-f1602555-861e-4618-b0b6-a5e5fceecf14 (f1602555-861e-4618-b0b6-a5e5fceecf14): created successfully Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1012777f-8d85-4be8-8222-2e3f76da597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6c9bb0fa-61f7-4787-a3e9-40483c221d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7344af-b512-41fe-9d29-a46e140eb302]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:16 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c9ce67e0-e52d-4a55-94b0-46b529d04a64 tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:37:16 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 Jul 08 11:37:16 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:16 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:16 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:16 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:17 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529" returned: 0 in 0.759s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:17 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 1G Jul 08 11:37:17 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:17 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.753s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:17 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7 Jul 08 11:37:17 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:17 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 1G" returned: 0 in 0.848s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc67640-fed0-4c77-b572-611a64920529 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:18 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc67640-fed0-4c77-b572-611a64920529 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 Jul 08 11:37:18 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:18 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff.1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7" released by "_delete_snapshot" :: held 3.126s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" released by "delete_snapshot" :: held 3.150s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Created reservations ['6cabb2e3-eacc-4b63-a1c2-068998d229a1', '939ad8bc-5bd8-49a3-926a-f32f8f407480', '3a47b100-a650-4e88-8ec9-649e527eb756', 'eb391a2c-e2ff-4404-88d0-f11af39e374d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Delete snapshot completed successfully. Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-8e08eb47-25f9-4072-9641-f131edb4a60b tempest-VolumeDependencyTests-728541794 None] Lock "cinder-1c3489c3-bcdf-49fc-a4d9-b89be6ec32e7-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:18 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc67640-fed0-4c77-b572-611a64920529 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:18 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 is being set with open permissions: ugo+rw Jul 08 11:37:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:18 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 Jul 08 11:37:18 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:19 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:19 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info Jul 08 11:37:19 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-4657a140-a0f1-4322-8e45-75aa8fe64aff-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "cinder-4657a140-a0f1-4322-8e45-75aa8fe64aff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a10ae6-a1e5-498f-852d-1ac5048fb4b3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:19 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:19 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:37:19 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:20 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:20 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info is being set with open permissions: ugo+rw Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:20 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info Jul 08 11:37:20 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:20 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.768s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:20 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff Jul 08 11:37:20 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:20 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.info" returned: 0 in 0.647s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.772s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230716876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6792d7-d088-4131-800b-27a28b0c1e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:09Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Creating volume ab6792d7-d088-4131-800b-27a28b0c1e7a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:20 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:20 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a 1073741824 Jul 08 11:37:20 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:20 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-112bbe6a-9427-4b6a-8fb6-2732035a3403 tempest-ProjectReaderTests-993732665 None] Create snapshot completed successfully Jul 08 11:37:21 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-4657a140-a0f1-4322-8e45-75aa8fe64aff" returned: 0 in 0.679s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-4657a140-a0f1-4322-8e45-75aa8fe64aff" released by "delete_volume" :: held 1.513s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Created reservations ['0ea1bf5e-9e80-41cb-8f0b-1bfe0045abc2', 'dbc0ffd5-cc2c-4510-9d81-a0f3b325391b', '0c76819b-4586-4089-b449-7bde27c2e117', '18f005f8-714e-4a0d-943a-98d86b792563'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:21 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:21 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-cd173b1e-6f30-4ef9-8892-3d13f79664d1-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-cd173b1e-6f30-4ef9-8892-3d13f79664d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-cd173b1e-6f30-4ef9-8892-3d13f79664d1" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-cd173b1e-6f30-4ef9-8892-3d13f79664d1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Deleting offline snapshot cd173b1e-6f30-4ef9-8892-3d13f79664d1 of volume edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] snapshot_file for this snap is: volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0209df78-bc62-45a7-886a-ab1be86a89b8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:21 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 Jul 08 11:37:21 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:21 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a 1073741824" returned: 0 in 0.885s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:21 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a Jul 08 11:37:21 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "cinder-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Acquiring lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" acquired by "delete_volume" :: waited 0.012s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c30532-0131-49e5-9614-cbfb316331b7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:21 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.761s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:21 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:21 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Deleted volume successfully. Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-0e9aff90-4314-4a19-9e4b-287498013f6a tempest-VolumeDependencyTests-728541794 None] Lock "cinder-4657a140-a0f1-4322-8e45-75aa8fe64aff-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:22 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef Jul 08 11:37:22 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:22 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1" returned: 0 in 0.894s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edc67640-fed0-4c77-b572-611a64920529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[70729c15-1221-4a16-b6e8-20df5e504eb6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:22 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 Jul 08 11:37:22 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:22 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.943s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3ab9ec-1354-42c2-be88-72fc146fb5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6792d7-d088-4131-800b-27a28b0c1e7a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9037f0b6-b3c7-4e8f-a80e-1beffb5877a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot c33c3958-5ffb-4931-8584-64d76fce0237 of volume f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:22 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Volume volume-ab6792d7-d088-4131-800b-27a28b0c1e7a (ab6792d7-d088-4131-800b-27a28b0c1e7a): created successfully Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9037f0b6-b3c7-4e8f-a80e-1beffb5877a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (1c81c6c9-b614-4816-ae9e-e766fd6e690c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f900f7-4ce0-4797-836d-f91c93f1f16a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-98e849cd-9cf4-4c00-898a-85fc772a993c tempest-ProjectReaderTests-1839377519 None] Created volume successfully. Jul 08 11:37:22 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 Jul 08 11:37:22 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:22 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" returned: 0 in 0.839s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:22 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef Jul 08 11:37:22 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-ab6792d7-d088-4131-800b-27a28b0c1e7a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-ab6792d7-d088-4131-800b-27a28b0c1e7a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-quobyte-ab6792d7-d088-4131-800b-27a28b0c1e7a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-ab6792d7-d088-4131-800b-27a28b0c1e7a" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:23 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529" returned: 0 in 0.925s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[05736e2d-4427-410d-8912-af1720400d4a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:23 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 Jul 08 11:37:23 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:23 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a Jul 08 11:37:23 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:23 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14" returned: 0 in 0.958s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:23 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 1G Jul 08 11:37:23 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:23 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" returned: 0 in 0.804s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "cinder-quobyte-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef" released by "delete_volume" :: held 1.697s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Created reservations ['1aaefe0c-c0b6-4ec0-8897-989d5339f054', '3ce53cc2-3cc8-4ee9-b003-b4a971eefc0a', '8b1956d3-b61e-4b54-906f-0f205b076804', 'b9a3b0a9-6aec-4f66-b734-cb041b02020e'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:23 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:23 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:24 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1" returned: 0 in 0.894s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:24 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1 Jul 08 11:37:24 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:24 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a" returned: 0 in 0.997s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:24 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a Jul 08 11:37:24 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:24 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 1G" returned: 0 in 1.055s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1602555-861e-4618-b0b6-a5e5fceecf14 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:24 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.876s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:24 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1602555-861e-4618-b0b6-a5e5fceecf14 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 Jul 08 11:37:24 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Deleted volume successfully. Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-101cb938-d10c-4a68-b325-6b7e41703dba tempest-VolumeDependencyTests-728541794 None] Lock "cinder-bb2a9485-b9bc-4607-b9a6-ab7b9f1ffaef-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:24 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529.cd173b1e-6f30-4ef9-8892-3d13f79664d1" returned: 0 in 0.741s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-cd173b1e-6f30-4ef9-8892-3d13f79664d1" released by "_delete_snapshot" :: held 3.559s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" released by "delete_snapshot" :: held 3.585s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:24 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Created reservations ['cefba8f8-4a70-47ad-b1aa-3af1a6a71c76', '7e517209-cb18-484a-9bcc-660f32a7d267', '5413e7f5-9910-48b1-a558-08c9d6d31291', '41868b06-fa7f-4422-86f1-c07beeabd245'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:25 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Delete snapshot completed successfully. Jul 08 11:37:25 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-ab6792d7-d088-4131-800b-27a28b0c1e7a" returned: 0 in 0.829s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1a434eb-17e2-44c4-bb68-dab94215645c tempest-ProjectReaderTests-993732665 None] Lock "cinder-cd173b1e-6f30-4ef9-8892-3d13f79664d1-delete_snapshot" released by "delete_snapshot" :: held 3.788s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-ab6792d7-d088-4131-800b-27a28b0c1e7a" released by "delete_volume" :: held 1.910s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Created reservations ['7d0209ed-ceca-421c-a9a8-a990c007d836', 'f2a4a30d-38cb-47ba-838d-555e52986431', 'a76d55cb-e1b3-4b0e-8159-9e962dd1dfdf', '0206771d-56e0-4a2e-bb61-99c8c7e94db7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:25 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:25 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:25 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1602555-861e-4618-b0b6-a5e5fceecf14 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237" returned: 0 in 0.872s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:25 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 is being set with open permissions: ugo+rw Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:25 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 Jul 08 11:37:25 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-edc67640-fed0-4c77-b572-611a64920529-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "cinder-edc67640-fed0-4c77-b572-611a64920529-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0768ab-8803-47c0-af07-c5bd94e12cf5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (3c25778e-abdf-4db2-b41c-b2269455ad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac73c553-aa08-4acf-97cc-d75f7500f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:26 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 Jul 08 11:37:26 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:26 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac73c553-aa08-4acf-97cc-d75f7500f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806283786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0248317-2225-4741-a122-37242531843e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:26Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576db659-20da-4037-a375-f5ebe77d5387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576db659-20da-4037-a375-f5ebe77d5387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4912c4ee-ad0c-4395-a41d-c8479058099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4912c4ee-ad0c-4395-a41d-c8479058099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0248317-2225-4741-a122-37242531843e', 'volume_name': 'volume-b0248317-2225-4741-a122-37242531843e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48647832-317e-45f6-8bf5-b0e96d82ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48647832-317e-45f6-8bf5-b0e96d82ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec49125-9dc9-4758-89c3-eed44c634007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:26 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Volume b0248317-2225-4741-a122-37242531843e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0248317-2225-4741-a122-37242531843e', 'volume_size': 1} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.910s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:26 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Deleted volume successfully. Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5c9c59e9-d8f3-467b-b3e2-5e97d73ea930 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-ab6792d7-d088-4131-800b-27a28b0c1e7a-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:26 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237" returned: 0 in 0.995s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:26 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info Jul 08 11:37:26 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:26 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529" returned: 0 in 0.926s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:26 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529 Jul 08 11:37:26 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:27 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info" returned: 0 in 0.755s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:27 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info is being set with open permissions: ugo+rw Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:27 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info Jul 08 11:37:27 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:27 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-edc67640-fed0-4c77-b572-611a64920529" returned: 0 in 0.703s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-edc67640-fed0-4c77-b572-611a64920529" released by "delete_volume" :: held 1.701s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Created reservations ['a0b149c5-bb76-4f7f-bc8a-0375562578d9', 'f0838154-6125-490c-8dad-8085562d054e', '046813a0-bc13-44b0-9fbd-31b3865ea0a6', 'bae33bd6-3a48-4ca6-a40d-6efb565291b2'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:27 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:27 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:27 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.info" returned: 0 in 0.704s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.468s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-806283786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0248317-2225-4741-a122-37242531843e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:26Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Creating volume b0248317-2225-4741-a122-37242531843e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:27 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:28 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e 1073741824 Jul 08 11:37:28 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-cdf634cd-0113-4181-b64a-956d062f42c5 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:37:28 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:28 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Deleted volume successfully. Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-ed0a3fcd-da8b-49bc-a9c6-8f9c3db9fd65 tempest-ProjectReaderTests-993732665 None] Lock "cinder-edc67640-fed0-4c77-b572-611a64920529-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (b00a4bc3-f848-4cbe-8732-a7494516ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f59e82-e565-4de7-b30a-35cd8ca6e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f59e82-e565-4de7-b30a-35cd8ca6e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991547233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:28Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9716d641-a187-4969-8350-d53e3bb748e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9716d641-a187-4969-8350-d53e3bb748e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adf49a7-766a-41f8-a6a1-623f1a4473ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adf49a7-766a-41f8-a6a1-623f1a4473ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d', 'volume_name': 'volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e1c54b-8bc8-4e49-b59b-bcacb559fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e1c54b-8bc8-4e49-b59b-bcacb559fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489c8b79-a52e-4979-bd7c-2e6ff6ff2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:28 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Volume 6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d', 'volume_size': 1} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-d104ab06-c49b-4a31-90a8-be584317acac tempest-ProjectAdminTests-288681794 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7354888916016, 'free_capacity_gb': 1775.7354888916016, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86852) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 11:37:28 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e 1073741824" returned: 0 in 0.896s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:28 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e Jul 08 11:37:28 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-c33c3958-5ffb-4931-8584-64d76fce0237-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-c33c3958-5ffb-4931-8584-64d76fce0237-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-c33c3958-5ffb-4931-8584-64d76fce0237" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-c33c3958-5ffb-4931-8584-64d76fce0237" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot c33c3958-5ffb-4931-8584-64d76fce0237 of volume f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0915b7ac-9c73-4e5b-b5cb-d3ef47999005]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:29 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 Jul 08 11:37:29 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:29 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991547233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:28Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Creating volume 6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:29 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec49125-9dc9-4758-89c3-eed44c634007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0248317-2225-4741-a122-37242531843e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:29 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d 1073741824 Jul 08 11:37:29 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae5160b-dfbb-42a7-87bd-9cfe52b52926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:29 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Volume volume-b0248317-2225-4741-a122-37242531843e (b0248317-2225-4741-a122-37242531843e): created successfully Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae5160b-dfbb-42a7-87bd-9cfe52b52926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (3c25778e-abdf-4db2-b41c-b2269455ad1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-9e07f91b-de0b-4044-9fde-6d4241307144 tempest-ProjectReaderTests-1839377519 None] Created volume successfully. Jul 08 11:37:29 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237" returned: 0 in 0.847s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1602555-861e-4618-b0b6-a5e5fceecf14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a90fa-93a3-40f7-8ff8-72f2289c6a53]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:30 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 Jul 08 11:37:30 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-b0248317-2225-4741-a122-37242531843e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-b0248317-2225-4741-a122-37242531843e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-quobyte-b0248317-2225-4741-a122-37242531843e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-b0248317-2225-4741-a122-37242531843e" acquired by "delete_volume" :: waited 0.028s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61914a0-6b4d-4905-96f7-b97b0a132f43]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:30 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e Jul 08 11:37:30 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:30 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d 1073741824" returned: 0 in 1.112s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:30 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d Jul 08 11:37:30 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:30 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14" returned: 0 in 0.950s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:30 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 Jul 08 11:37:30 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:31 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e" returned: 0 in 0.896s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:31 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e Jul 08 11:37:31 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:31 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" returned: 0 in 0.708s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489c8b79-a52e-4979-bd7c-2e6ff6ff2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41145ea6-0ae1-47e9-b5d1-57ae4dc41d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:31 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Volume volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d (6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d): created successfully Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41145ea6-0ae1-47e9-b5d1-57ae4dc41d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (b00a4bc3-f848-4cbe-8732-a7494516ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:31 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2ee22871-9d79-41e5-ad2e-1e08bf47b6d1 tempest-ProjectReaderTests-993732665 None] Created volume successfully. Jul 08 11:37:31 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237" returned: 0 in 0.820s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:31 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237 Jul 08 11:37:31 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:32 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-b0248317-2225-4741-a122-37242531843e" returned: 0 in 0.685s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-b0248317-2225-4741-a122-37242531843e" released by "delete_volume" :: held 1.632s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Created reservations ['a3454994-f70a-4d74-8cfa-9ebc4f381534', 'e3e58dd2-109a-42b6-84dc-adc70e92aef9', '59d1897d-3c38-4cfc-a3e5-2871c62f4de3', 'e79812d6-3a5a-42ec-8a6d-f82723161091'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:32 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:32 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:32 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14.c33c3958-5ffb-4931-8584-64d76fce0237" returned: 0 in 0.672s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-c33c3958-5ffb-4931-8584-64d76fce0237" released by "_delete_snapshot" :: held 3.414s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" released by "delete_snapshot" :: held 3.442s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Created reservations ['f6eba158-a558-4a98-8735-ab536f3475e7', 'de49b982-884a-44e9-96fa-2884129b9697', '635b5925-123e-4711-b98e-76ea3a872e10', '0b7b9337-12af-405d-8a7b-4d39f4e7546d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-4c7ec4e4-5469-468e-9476-65f99819b55c tempest-ProjectMemberTests-872509998 None] Lock "cinder-c33c3958-5ffb-4931-8584-64d76fce0237-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:32 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:32 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Deleted volume successfully. Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-02d9a41c-3a72-40e4-a2eb-06da7709a5e4 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-b0248317-2225-4741-a122-37242531843e-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:32 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Creating offline snapshot ca14f3d6-54f7-4986-8488-29d986a6b3e3 of volume 6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f056ed36-d4f1-4970-8654-11d674e3c03d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:33 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d Jul 08 11:37:33 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (cbcf9a6b-8cf6-4d46-af7d-980a87462f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689463a3-c65d-41df-8c2d-2df525e45561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689463a3-c65d-41df-8c2d-2df525e45561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669438495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765a33cd-b415-4e25-a0b5-d5f812f14eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:33Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80479e5-4f23-4f73-ab09-5443c75ff48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80479e5-4f23-4f73-ab09-5443c75ff48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852854e4-8faf-44d5-b64d-300757ac065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852854e4-8faf-44d5-b64d-300757ac065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765a33cd-b415-4e25-a0b5-d5f812f14eeb', 'volume_name': 'volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d9e5fe-6adf-495d-b922-f9d94228d3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d9e5fe-6adf-495d-b922-f9d94228d3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa2e5f2-d82d-4f7e-9ad2-eb2b2c996e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:33 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Volume 765a33cd-b415-4e25-a0b5-d5f812f14eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb', 'volume_size': 1} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-f1602555-861e-4618-b0b6-a5e5fceecf14-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "cinder-f1602555-861e-4618-b0b6-a5e5fceecf14-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e0e30-f85f-4e00-8707-8131380226ff]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:33 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 Jul 08 11:37:33 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:33 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" returned: 0 in 0.797s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:33 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 1G Jul 08 11:37:33 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:34 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14" returned: 0 in 0.781s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:34 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14 Jul 08 11:37:34 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:34 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 1G" returned: 0 in 0.809s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:34 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 Jul 08 11:37:34 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:35 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f1602555-861e-4618-b0b6-a5e5fceecf14" returned: 0 in 0.656s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-f1602555-861e-4618-b0b6-a5e5fceecf14" released by "delete_volume" :: held 1.497s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Created reservations ['488c693b-6476-4b0a-8ba8-3355952a6bba', '4d81581f-1ea1-4392-af0b-1edd8471ed02', '0897edb1-7e9f-41a7-8413-3a6fff9645ff', 'db0b06e9-3c65-47ef-945b-8d4022acd4ed'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:35 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:35 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:35 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:35 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 is being set with open permissions: ugo+rw Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:35 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 Jul 08 11:37:35 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:35 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:37:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-120e9358-d675-4920-b0c1-ed97517d114b tempest-ProjectMemberTests-872509998 None] Lock "cinder-f1602555-861e-4618-b0b6-a5e5fceecf14-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:36 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:36 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info Jul 08 11:37:36 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (aa85af3b-18f3-4515-8e30-ee11cfe75007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fc7b0-0f8a-4780-b3a1-39cd6ef6a830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fc7b0-0f8a-4780-b3a1-39cd6ef6a830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550442260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9d5c85-2096-45fd-831a-148b5a1ee8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:36Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186fe7ed-e2a8-40df-8842-db1658a7d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186fe7ed-e2a8-40df-8842-db1658a7d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c9fe11-fc3a-4834-a7a9-59e8090703c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c9fe11-fc3a-4834-a7a9-59e8090703c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9d5c85-2096-45fd-831a-148b5a1ee8ad', 'volume_name': 'volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6cde57-39ee-4776-9d3b-960d928fc6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6cde57-39ee-4776-9d3b-960d928fc6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee81001-eda2-484d-8abb-c660a10fb0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Volume 5f9d5c85-2096-45fd-831a-148b5a1ee8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad', 'volume_size': 1} Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:36 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info" returned: 0 in 0.710s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:36 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info is being set with open permissions: ugo+rw Jul 08 11:37:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:36 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info Jul 08 11:37:36 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:37 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.info" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.204s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669438495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765a33cd-b415-4e25-a0b5-d5f812f14eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824a00c0f655436dbab827da0e4f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:33Z,use_quota=True,user_id='6b7df794ff7e412ebb2a9b5e5770929b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Creating volume 765a33cd-b415-4e25-a0b5-d5f812f14eeb {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:37 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:37 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb 1073741824 Jul 08 11:37:37 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-05fbf009-5701-4510-9d09-3e33d493c6df tempest-ProjectReaderTests-993732665 None] Create snapshot completed successfully Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-ca14f3d6-54f7-4986-8488-29d986a6b3e3-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-ca14f3d6-54f7-4986-8488-29d986a6b3e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-ca14f3d6-54f7-4986-8488-29d986a6b3e3" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ca14f3d6-54f7-4986-8488-29d986a6b3e3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Deleting offline snapshot ca14f3d6-54f7-4986-8488-29d986a6b3e3 of volume 6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:38 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] snapshot_file for this snap is: volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb 1073741824" returned: 0 in 0.859s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa61da3-1537-43b9-9bb3-cfc0aa9bb28b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:38 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb Jul 08 11:37:38 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:38 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 Jul 08 11:37:38 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:39 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550442260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9d5c85-2096-45fd-831a-148b5a1ee8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:36Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Creating volume 5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:39 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:39 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad 1073741824 Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa2e5f2-d82d-4f7e-9ad2-eb2b2c996e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:39 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481ebfa-f733-4f6f-8bb9-d4858357a56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=150,cinder:INSERT=56,cinder:UPDATE=209,cinder:DELETE=13 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:37:39 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Volume volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb (765a33cd-b415-4e25-a0b5-d5f812f14eeb): created successfully Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3481ebfa-f733-4f6f-8bb9-d4858357a56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Flow 'volume_create_manager' (cbcf9a6b-8cf6-4d46-af7d-980a87462f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:39 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-92d0d2ea-68eb-4bb8-b97a-895a0371b0a3 tempest-ProjectReaderTests-1839377519 None] Created volume successfully. Jul 08 11:37:39 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3" returned: 0 in 0.788s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1aba4-7b33-41c1-be84-c54580888d4a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:39 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d Jul 08 11:37:39 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-765a33cd-b415-4e25-a0b5-d5f812f14eeb-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-765a33cd-b415-4e25-a0b5-d5f812f14eeb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=145,cinder:UPDATE=198,cinder:DELETE=22,cinder:INSERT=45 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "cinder-quobyte-765a33cd-b415-4e25-a0b5-d5f812f14eeb" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-765a33cd-b415-4e25-a0b5-d5f812f14eeb" acquired by "delete_volume" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee0127-37b2-493d-8f05-27ebfbd66415]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:39 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb Jul 08 11:37:39 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:39 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad 1073741824" returned: 0 in 0.895s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:39 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:40 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 Jul 08 11:37:40 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:40 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad Jul 08 11:37:40 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:40 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb" returned: 0 in 0.861s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:40 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb Jul 08 11:37:40 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:40 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee81001-eda2-484d-8abb-c660a10fb0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877fa168-1851-410f-97dc-7c9a23c55276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:40 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Volume volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad (5f9d5c85-2096-45fd-831a-148b5a1ee8ad): created successfully Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877fa168-1851-410f-97dc-7c9a23c55276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (aa85af3b-18f3-4515-8e30-ee11cfe75007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:40 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-63901b28-b2af-4d46-89bc-b67be4f5ea1b tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:37:40 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3" returned: 0 in 0.762s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:40 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3 Jul 08 11:37:40 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:41 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-765a33cd-b415-4e25-a0b5-d5f812f14eeb" returned: 0 in 0.674s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-quobyte-765a33cd-b415-4e25-a0b5-d5f812f14eeb" released by "delete_volume" :: held 1.572s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Created reservations ['67124274-5695-4fad-8ad7-259bb0b54502', '41511c1d-bb68-46ef-99bd-4a11eae981d2', '04548d7e-ac79-4f24-85d8-47b1b0f3f676', '09c9e8b4-6bed-4db7-9428-48a5d026cdc8'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:41 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:41 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:41 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d.ca14f3d6-54f7-4986-8488-29d986a6b3e3" returned: 0 in 0.689s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-ca14f3d6-54f7-4986-8488-29d986a6b3e3" released by "_delete_snapshot" :: held 3.150s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" released by "delete_snapshot" :: held 3.172s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Created reservations ['21f08427-3fbf-43a2-adbd-3ebb038994c6', '9fff4343-c628-4ced-9684-7328ee980123', '50c05be3-bed2-43bc-a905-cea6e648da26', '8b6cd93b-1dc4-4d45-a806-e2dfb1dca1e8'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:41 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Delete snapshot completed successfully. Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-67a63eb4-f94f-4033-9fc9-c0d330138942 tempest-ProjectReaderTests-993732665 None] Lock "cinder-ca14f3d6-54f7-4986-8488-29d986a6b3e3-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Creating offline snapshot bb77509f-dd66-4eff-9334-bdc45ccc4f8f of volume 5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59daa46-71b3-4ae5-9c52-80eb7c143305]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:41 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad Jul 08 11:37:41 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:42 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Deleted volume successfully. Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-1c6f788f-e190-4bf6-8d62-58e2dd76b6d3 tempest-ProjectReaderTests-1839377519 None] Lock "cinder-765a33cd-b415-4e25-a0b5-d5f812f14eeb-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "cinder-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:42 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" returned: 0 in 0.836s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:42 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f 1G Jul 08 11:37:42 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ffba6f-26a2-42a3-9520-20be6a0f9d53]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:42 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d Jul 08 11:37:42 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:43 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:43 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f 1G" returned: 0 in 0.945s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" returned: 0 in 0.868s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:43 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f Jul 08 11:37:43 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:43 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d Jul 08 11:37:43 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:44 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" returned: 0 in 0.681s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:44 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d" released by "delete_volume" :: held 1.609s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f" returned: 0 in 0.720s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:44 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f is being set with open permissions: ugo+rw Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:44 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f Jul 08 11:37:44 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Created reservations ['2c87bb62-9c37-4ab5-8afa-0bbb61e5c178', '83a6934c-eeba-487f-925d-1d0a9ac7e4cf', '849246fb-b448-4dde-ad4f-37c7a13c8d82', 'a9c69076-4cd1-4016-8bf0-7692038b73ed'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:44 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:44 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:44 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f" returned: 0 in 0.665s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:44 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info Jul 08 11:37:44 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:44 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.644s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:44 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:44 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Deleted volume successfully. Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-98fde7c0-0b4b-46e7-a0f8-6298a815a672 tempest-ProjectReaderTests-993732665 None] Lock "cinder-6bd6caec-488e-4eb9-8c7c-62c2a0d41f6d-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (967ea076-04e1-4ae9-83c5-0836604eea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff0100-e8eb-4eb5-bf36-a2b9e6a86b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff0100-e8eb-4eb5-bf36-a2b9e6a86b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341194106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164e2443-5861-475a-b027-3070ccd694f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:45Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4b9f63-54ed-49e1-b3d8-aba2d29601b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4b9f63-54ed-49e1-b3d8-aba2d29601b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69425589-2172-4d62-be9b-dab5402d7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69425589-2172-4d62-be9b-dab5402d7c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164e2443-5861-475a-b027-3070ccd694f6', 'volume_name': 'volume-164e2443-5861-475a-b027-3070ccd694f6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf27d3c-f52e-4892-a2b8-f2a0faabb69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf27d3c-f52e-4892-a2b8-f2a0faabb69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5dc8d-3581-4b6a-b8f8-5344dae9321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:45 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Volume 164e2443-5861-475a-b027-3070ccd694f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164e2443-5861-475a-b027-3070ccd694f6', 'volume_size': 1} Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:45 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info" returned: 0 in 0.661s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:45 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info is being set with open permissions: ugo+rw Jul 08 11:37:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:45 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info Jul 08 11:37:45 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:46 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.info" returned: 0 in 0.635s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341194106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164e2443-5861-475a-b027-3070ccd694f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:45Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Creating volume 164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:46 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:46 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 1073741824 Jul 08 11:37:46 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3b2244b3-566e-4383-a85f-305f2a322f6c tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-bb77509f-dd66-4eff-9334-bdc45ccc4f8f-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-bb77509f-dd66-4eff-9334-bdc45ccc4f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-bb77509f-dd66-4eff-9334-bdc45ccc4f8f" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-bb77509f-dd66-4eff-9334-bdc45ccc4f8f" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot bb77509f-dd66-4eff-9334-bdc45ccc4f8f of volume 5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f9654-e6a9-4618-a647-6dcccf7ad5b1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:47 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 1073741824" returned: 0 in 0.860s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:47 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f Jul 08 11:37:47 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:47 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 Jul 08 11:37:47 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:47 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6" returned: 0 in 0.645s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f5dc8d-3581-4b6a-b8f8-5344dae9321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164e2443-5861-475a-b027-3070ccd694f6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5544bf5-2d05-41df-a48e-4d41e7263c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:47 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f" returned: 0 in 0.765s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:47 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Volume volume-164e2443-5861-475a-b027-3070ccd694f6 (164e2443-5861-475a-b027-3070ccd694f6): created successfully Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5544bf5-2d05-41df-a48e-4d41e7263c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (967ea076-04e1-4ae9-83c5-0836604eea04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfbae7-d7c7-4a68-9289-3c4aae869f05]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:47 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e0d23ab7-453a-4d31-9750-a58d1b8b1d3c tempest-ProjectReaderTests-993732665 None] Created volume successfully. Jul 08 11:37:47 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad Jul 08 11:37:47 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Creating offline snapshot 4299909e-5976-4f2c-8598-783e46b9f025 of volume 164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9ef22-7268-45f9-883e-1b5aeb95e941]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:48 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:48 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 Jul 08 11:37:48 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:48 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f Jul 08 11:37:48 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:49 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6" returned: 0 in 0.790s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:49 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 1G Jul 08 11:37:49 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:49 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f" returned: 0 in 0.741s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:49 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f Jul 08 11:37:49 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:50 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad.bb77509f-dd66-4eff-9334-bdc45ccc4f8f" returned: 0 in 0.648s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-bb77509f-dd66-4eff-9334-bdc45ccc4f8f" released by "_delete_snapshot" :: held 3.030s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" released by "delete_snapshot" :: held 3.119s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:50 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 1G" returned: 0 in 0.802s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164e2443-5861-475a-b027-3070ccd694f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Created reservations ['2ba4d933-2b41-421a-a02f-eeeeee04247a', '9635591c-4e8a-43a5-a9fc-d3d4cb908ddc', 'cff25947-f983-47cb-8d42-878d46426efb', '795048ba-8d36-41fe-9fc8-a8ca0c477584'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:50 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164e2443-5861-475a-b027-3070ccd694f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 Jul 08 11:37:50 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-d0aa4079-ba5a-4da3-b63a-fb2b0d56a5e3 tempest-ProjectMemberTests-872509998 None] Lock "cinder-bb77509f-dd66-4eff-9334-bdc45ccc4f8f-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:50 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-164e2443-5861-475a-b027-3070ccd694f6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025" returned: 0 in 0.675s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:50 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 is being set with open permissions: ugo+rw Jul 08 11:37:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:50 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 Jul 08 11:37:50 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-5f9d5c85-2096-45fd-831a-148b5a1ee8ad-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "cinder-5f9d5c85-2096-45fd-831a-148b5a1ee8ad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e90f1df-300e-4613-b973-f5dee053b4f1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:51 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad Jul 08 11:37:51 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:51 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025" returned: 0 in 0.655s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:51 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info Jul 08 11:37:51 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:52 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:52 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad Jul 08 11:37:52 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:52 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info" returned: 0 in 0.651s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:52 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info is being set with open permissions: ugo+rw Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:52 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info Jul 08 11:37:52 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:52 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:52 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:52 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5f9d5c85-2096-45fd-831a-148b5a1ee8ad" released by "delete_volume" :: held 1.509s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Created reservations ['bcd2f205-9e6a-4779-9ee4-5bcdc86849e4', '1c353b25-bf38-43bc-b7c1-9b22e8b49418', '6ed2e2e0-206d-4f3d-8e4c-42737f621d82', '8c711070-6011-4a3d-9cb7-dafdeb6abbc7'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:52 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.info" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.358s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bccadfdf-5d69-4d27-81f9-6c851fbab63b tempest-ProjectReaderTests-993732665 None] Create snapshot completed successfully Jul 08 11:37:52 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:52 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:53 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.687s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:37:53 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:37:53 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-65479a8d-695e-4045-8a00-6fb76aed82c5 tempest-ProjectMemberTests-872509998 None] Lock "cinder-5f9d5c85-2096-45fd-831a-148b5a1ee8ad-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-4299909e-5976-4f2c-8598-783e46b9f025-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-4299909e-5976-4f2c-8598-783e46b9f025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-4299909e-5976-4f2c-8598-783e46b9f025" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-4299909e-5976-4f2c-8598-783e46b9f025" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Deleting offline snapshot 4299909e-5976-4f2c-8598-783e46b9f025 of volume 164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] snapshot_file for this snap is: volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdf86d-3a6a-48bb-9527-2a5095d4d1cc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (3f55b8f8-0d87-4f69-a39f-7b46e93e2e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95f611a-8b6e-423b-9097-7df3cd592c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95f611a-8b6e-423b-9097-7df3cd592c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964971534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462122d2-80bf-4f39-a120-d3503d5c5c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:54Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f6602-896d-4893-86c0-95cf289e7cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911f6602-896d-4893-86c0-95cf289e7cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c09f14-3db3-4913-994a-f1c765f1ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c09f14-3db3-4913-994a-f1c765f1ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462122d2-80bf-4f39-a120-d3503d5c5c65', 'volume_name': 'volume-462122d2-80bf-4f39-a120-d3503d5c5c65', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91009f50-4e3f-4062-8556-7b507213a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91009f50-4e3f-4062-8556-7b507213a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:53 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 Jul 08 11:37:53 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d332ed-e9a2-401b-97ee-31fbfefda12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:53 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Volume 462122d2-80bf-4f39-a120-d3503d5c5c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462122d2-80bf-4f39-a120-d3503d5c5c65', 'volume_size': 1} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964971534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462122d2-80bf-4f39-a120-d3503d5c5c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:37:54Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Creating volume 462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:37:53 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:37:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:53 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 1073741824 Jul 08 11:37:53 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:54 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025" returned: 0 in 0.753s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-164e2443-5861-475a-b027-3070ccd694f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e5e38-6372-4baa-aa3f-7293524da1ca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:54 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 Jul 08 11:37:54 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:54 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 1073741824" returned: 0 in 0.851s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:54 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 Jul 08 11:37:54 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:55 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6" returned: 0 in 0.755s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:55 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 Jul 08 11:37:55 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:55 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65" returned: 0 in 0.640s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d332ed-e9a2-401b-97ee-31fbfefda12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462122d2-80bf-4f39-a120-d3503d5c5c65', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50fc287-9d76-46e6-801f-8fe2e7f19bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:37:55 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Volume volume-462122d2-80bf-4f39-a120-d3503d5c5c65 (462122d2-80bf-4f39-a120-d3503d5c5c65): created successfully Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50fc287-9d76-46e6-801f-8fe2e7f19bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:37:55 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (3f55b8f8-0d87-4f69-a39f-7b46e93e2e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:37:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-cbeccba0-5a7b-498e-9d97-34be9fbb2911 tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:56 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot 28167ed6-6cb9-469d-b53e-c585e73e3b2c of volume 462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c08578-79a0-41df-a5e1-596f59752277]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:56 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025 Jul 08 11:37:56 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:56 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 Jul 08 11:37:56 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:56 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6.4299909e-5976-4f2c-8598-783e46b9f025" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-4299909e-5976-4f2c-8598-783e46b9f025" released by "_delete_snapshot" :: held 2.979s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" released by "delete_snapshot" :: held 2.999s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Created reservations ['f70b6cc5-2eb2-4c8d-98de-17a2fdd480e0', 'da74a68b-4b1e-4b31-bd10-f56678e5d785', '11320650-6972-4403-8896-922c3780505a', '5fd5e585-911e-4fa6-9b8d-02f534eac7ea'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:56 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65" returned: 0 in 0.767s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:56 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c 1G Jul 08 11:37:56 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:56 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Delete snapshot completed successfully. Jul 08 11:37:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-35f68ccc-b847-42fc-b273-a88147db46d2 tempest-ProjectReaderTests-993732665 None] Lock "cinder-4299909e-5976-4f2c-8598-783e46b9f025-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:57 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c 1G" returned: 0 in 0.787s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462122d2-80bf-4f39-a120-d3503d5c5c65 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:57 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462122d2-80bf-4f39-a120-d3503d5c5c65 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c Jul 08 11:37:57 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-164e2443-5861-475a-b027-3070ccd694f6-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:57 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "cinder-164e2443-5861-475a-b027-3070ccd694f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd046b35-104d-4324-a3e0-1c2d875088dd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:58 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 Jul 08 11:37:58 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:58 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462122d2-80bf-4f39-a120-d3503d5c5c65 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:58 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c is being set with open permissions: ugo+rw Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:58 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c Jul 08 11:37:58 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:58 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6" returned: 0 in 0.764s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:58 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6 Jul 08 11:37:58 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:58 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c" returned: 0 in 0.649s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:59 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info Jul 08 11:37:59 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:59 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-164e2443-5861-475a-b027-3070ccd694f6" returned: 0 in 0.651s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-164e2443-5861-475a-b027-3070ccd694f6" released by "delete_volume" :: held 1.471s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Created reservations ['257d90e0-b530-4759-962f-e15292115de7', '688cfabf-395c-4c0f-a021-7cc4396cfe3b', '0aea58e1-dcf7-4f99-8574-4f4b7d2f0be3', 'a2935290-5129-45b4-b4a5-43b3a499b1bf'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:59 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:37:59 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:37:59 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:37:59 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info is being set with open permissions: ugo+rw Jul 08 11:37:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:37:59 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info Jul 08 11:37:59 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:00 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.669s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Deleted volume successfully. Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b1e81d04-3d9b-4b41-8da1-c9f95a7dc9ca tempest-ProjectReaderTests-993732665 None] Lock "cinder-164e2443-5861-475a-b027-3070ccd694f6-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:00 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.info" returned: 0 in 0.677s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:00 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-637efad1-ceb5-4a95-be99-4f494f749752 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (efd99256-e8d6-45a1-99fb-9590acb52c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a415d4-58e9-4190-91ce-b88984932b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a415d4-58e9-4190-91ce-b88984932b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148467185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073d973b-6771-44a8-8613-54bd993dfd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:01Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcede3a-fd00-4e93-92a8-72580cdf4429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcede3a-fd00-4e93-92a8-72580cdf4429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb66ca7b-89ab-4046-8dbf-c44cf72b5816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb66ca7b-89ab-4046-8dbf-c44cf72b5816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073d973b-6771-44a8-8613-54bd993dfd73', 'volume_name': 'volume-073d973b-6771-44a8-8613-54bd993dfd73', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b52ff6-4a43-4822-ad04-b988c66607f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b52ff6-4a43-4822-ad04-b988c66607f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b8288-1e7d-4958-8757-6145bdb3c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:00 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Volume 073d973b-6771-44a8-8613-54bd993dfd73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073d973b-6771-44a8-8613-54bd993dfd73', 'volume_size': 1} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148467185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073d973b-6771-44a8-8613-54bd993dfd73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08683a2090714c3c935cd30052383127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:01Z,use_quota=True,user_id='6f01c7912ec94deaae3ffd5349c4442b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Creating volume 073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:38:00 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:38:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:00 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 1073741824 Jul 08 11:38:00 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-28167ed6-6cb9-469d-b53e-c585e73e3b2c-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-28167ed6-6cb9-469d-b53e-c585e73e3b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-28167ed6-6cb9-469d-b53e-c585e73e3b2c" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-28167ed6-6cb9-469d-b53e-c585e73e3b2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot 28167ed6-6cb9-469d-b53e-c585e73e3b2c of volume 462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6f4df-724b-46c5-9b65-a247748fc942]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:01 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c Jul 08 11:38:01 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:01 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 1073741824" returned: 0 in 0.838s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:01 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 Jul 08 11:38:01 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:02 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c" returned: 0 in 0.769s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462122d2-80bf-4f39-a120-d3503d5c5c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e72be3-9259-4453-a708-c94aebdf4d2f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:02 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b8288-1e7d-4958-8757-6145bdb3c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073d973b-6771-44a8-8613-54bd993dfd73', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec43594-62fd-48dc-8626-54164b546856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:02 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 Jul 08 11:38:02 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Volume volume-073d973b-6771-44a8-8613-54bd993dfd73 (073d973b-6771-44a8-8613-54bd993dfd73): created successfully Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec43594-62fd-48dc-8626-54164b546856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Flow 'volume_create_manager' (efd99256-e8d6-45a1-99fb-9590acb52c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-939d6793-66db-42a5-831b-2431623b1b98 tempest-ProjectReaderTests-993732665 None] Created volume successfully. Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Creating offline snapshot 5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 of volume 073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a62a0f-6ffd-4f60-8244-3f9552c19099]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:02 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65" returned: 0 in 0.791s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:02 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c Jul 08 11:38:02 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:03 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 Jul 08 11:38:03 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:03 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73" returned: 0 in 0.763s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:03 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 1G Jul 08 11:38:03 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:03 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c" returned: 0 in 0.752s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:03 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c Jul 08 11:38:03 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:04 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65.28167ed6-6cb9-469d-b53e-c585e73e3b2c" returned: 0 in 0.645s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-28167ed6-6cb9-469d-b53e-c585e73e3b2c" released by "_delete_snapshot" :: held 3.056s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" released by "delete_snapshot" :: held 3.080s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Created reservations ['4c12a5db-728c-4358-a777-560d7fa07937', '8b6ce111-64a8-4a7f-b306-3ce948b40d74', 'd86ffd5c-c401-46c4-92de-1d341b45b990', 'ce7db875-6257-4a4e-a83f-5f601951d236'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:04 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 1G" returned: 0 in 0.795s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073d973b-6771-44a8-8613-54bd993dfd73 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:04 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073d973b-6771-44a8-8613-54bd993dfd73 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 Jul 08 11:38:04 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:38:04 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b11e0062-7b28-4d9c-80a2-c7ec32f53244 tempest-ProjectMemberTests-872509998 None] Lock "cinder-28167ed6-6cb9-469d-b53e-c585e73e3b2c-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:05 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-073d973b-6771-44a8-8613-54bd993dfd73 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:05 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 is being set with open permissions: ugo+rw Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:05 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 Jul 08 11:38:05 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-462122d2-80bf-4f39-a120-d3503d5c5c65-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "cinder-462122d2-80bf-4f39-a120-d3503d5c5c65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92efb79-977b-44e5-97c0-6b39d934524f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:05 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 Jul 08 11:38:05 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:05 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:05 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info Jul 08 11:38:05 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:06 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:06 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65 Jul 08 11:38:06 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:06 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:06 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info is being set with open permissions: ugo+rw Jul 08 11:38:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:06 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info Jul 08 11:38:06 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:07 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-462122d2-80bf-4f39-a120-d3503d5c5c65" returned: 0 in 0.666s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-462122d2-80bf-4f39-a120-d3503d5c5c65" released by "delete_volume" :: held 1.465s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Created reservations ['8084e9c5-6a3d-4bd0-a117-1e52c0708933', 'e1df1174-39f1-4ea7-9d08-31393f44c194', 'd37055cd-ed8b-411a-8eeb-7aeba1b15d1c', '48a69d0b-4782-4c00-b03d-f8b4c3c806a6'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:07 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.info" returned: 0 in 0.635s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.278s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-1506bfd5-fed4-435e-be8b-787a1f03567a tempest-ProjectReaderTests-993732665 None] Create snapshot completed successfully Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:07 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:07 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:07 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.619s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:07 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:38:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b0ab3f28-50b2-4dd3-8a91-ff5d04adf3ed tempest-ProjectMemberTests-872509998 None] Lock "cinder-462122d2-80bf-4f39-a120-d3503d5c5c65-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Deleting offline snapshot 5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 of volume 073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] snapshot_file for this snap is: volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ac0fd9-7b95-467c-b5e6-1a285d76c88a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (3a6e00e0-3fc7-426f-a2c0-fe5030da5937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2945fd-b876-4b10-a39e-869e8f1428c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2945fd-b876-4b10-a39e-869e8f1428c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553850538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf144119-3fc8-4134-84dd-b260a6b1c41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:08Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab67984-77a6-49f3-bbca-916ad0095c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab67984-77a6-49f3-bbca-916ad0095c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8863e3c-5d39-425b-898e-6adaf9dae602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8863e3c-5d39-425b-898e-6adaf9dae602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf144119-3fc8-4134-84dd-b260a6b1c41f', 'volume_name': 'volume-cf144119-3fc8-4134-84dd-b260a6b1c41f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0c2169-101f-4bcd-b556-640cf212d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0c2169-101f-4bcd-b556-640cf212d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559ea737-d3a4-4345-840a-9783e528059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:08 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Volume cf144119-3fc8-4134-84dd-b260a6b1c41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf144119-3fc8-4134-84dd-b260a6b1c41f', 'volume_size': 1} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:08 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553850538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf144119-3fc8-4134-84dd-b260a6b1c41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:08Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Creating volume cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:08 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:38:08 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:08 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f 1073741824 Jul 08 11:38:08 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:08 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-073d973b-6771-44a8-8613-54bd993dfd73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a90fe-5d3c-46f3-9d55-35f497a963b5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:09 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f 1073741824" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:09 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 Jul 08 11:38:09 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:09 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f Jul 08 11:38:09 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:09 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73" returned: 0 in 0.745s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:09 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 Jul 08 11:38:09 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:09 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f" returned: 0 in 0.647s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559ea737-d3a4-4345-840a-9783e528059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf144119-3fc8-4134-84dd-b260a6b1c41f', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3259366-2263-44e5-9fbb-8b75db44f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:09 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Volume volume-cf144119-3fc8-4134-84dd-b260a6b1c41f (cf144119-3fc8-4134-84dd-b260a6b1c41f): created successfully Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3259366-2263-44e5-9fbb-8b75db44f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:09 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (3a6e00e0-3fc7-426f-a2c0-fe5030da5937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:09 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-63d177bd-7e9a-4316-89e7-f3d77e21f5eb tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot dcc11fb6-3508-4fa3-b7df-3074a06303c9 of volume cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[42afca93-a803-49b5-aa0e-81c0085a1d7c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:10 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" returned: 0 in 0.757s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:10 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4 Jul 08 11:38:10 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:10 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f Jul 08 11:38:10 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:11 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73.5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" returned: 0 in 0.670s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:11 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f" returned: 0 in 0.774s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4" released by "_delete_snapshot" :: held 3.057s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" released by "delete_snapshot" :: held 3.092s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:11 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 1G Jul 08 11:38:11 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Created reservations ['1b688bde-0bd0-46b9-ad55-4dc9153f7184', 'cbad690a-63e0-4830-a1ed-88167e45e078', 'c23dc1e0-701f-4165-bf08-143563b217b1', '3a70cefe-8a75-4791-a892-3c0f840acfac'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:11 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Delete snapshot completed successfully. Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-891037a2-099b-4ef7-9a54-834f99dbb375 tempest-ProjectReaderTests-993732665 None] Lock "cinder-5f0c1008-35f9-4401-b0a0-a9f1c4bc50d4-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:11 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 1G" returned: 0 in 0.801s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf144119-3fc8-4134-84dd-b260a6b1c41f -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:12 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf144119-3fc8-4134-84dd-b260a6b1c41f -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 Jul 08 11:38:12 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-073d973b-6771-44a8-8613-54bd993dfd73-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "cinder-073d973b-6771-44a8-8613-54bd993dfd73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Acquiring lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[62133e72-27fe-48a9-a657-98b4829d2e7b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:12 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 Jul 08 11:38:12 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:12 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf144119-3fc8-4134-84dd-b260a6b1c41f -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9" returned: 0 in 0.682s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:12 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 is being set with open permissions: ugo+rw Jul 08 11:38:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:12 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 Jul 08 11:38:12 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:13 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73" returned: 0 in 0.791s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:13 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73 Jul 08 11:38:13 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:13 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9" returned: 0 in 0.676s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:13 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info Jul 08 11:38:13 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:13 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-073d973b-6771-44a8-8613-54bd993dfd73" returned: 0 in 0.657s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "cinder-quobyte-073d973b-6771-44a8-8613-54bd993dfd73" released by "delete_volume" :: held 1.513s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:13 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Created reservations ['501754bd-7438-4173-8a52-3c190c702e48', '9bb84341-90b3-4cf3-8ad2-8e64ef91de5c', '8bfb61e9-8dd8-401e-9348-58503a40fc2e', '0109f970-cc8d-4de3-873a-dcc1d8902029'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:14 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:14 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info is being set with open permissions: ugo+rw Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:14 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:14 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:14 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info Jul 08 11:38:14 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:14 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.651s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Deleted volume successfully. Jul 08 11:38:14 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.info" returned: 0 in 0.678s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.394s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-5b5a4818-e842-4b82-9ea5-3feefd4b2481 tempest-ProjectReaderTests-993732665 None] Lock "cinder-073d973b-6771-44a8-8613-54bd993dfd73-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-30932fb7-1d83-40e6-b1f0-39a84e432626 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-dcc11fb6-3508-4fa3-b7df-3074a06303c9-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-dcc11fb6-3508-4fa3-b7df-3074a06303c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-dcc11fb6-3508-4fa3-b7df-3074a06303c9" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-dcc11fb6-3508-4fa3-b7df-3074a06303c9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot dcc11fb6-3508-4fa3-b7df-3074a06303c9 of volume cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0b56a-08b1-46ef-8856-2195a409c688]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:15 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 Jul 08 11:38:15 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:16 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9" returned: 0 in 0.807s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:16 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf144119-3fc8-4134-84dd-b260a6b1c41f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:16 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b834dc-8789-462f-80ea-177a4770ce60]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:16 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:16 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f Jul 08 11:38:16 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:17 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f" returned: 0 in 0.808s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:17 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:17 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 Jul 08 11:38:17 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:18 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9" returned: 0 in 0.779s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:18 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9 Jul 08 11:38:18 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:18 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f.dcc11fb6-3508-4fa3-b7df-3074a06303c9" returned: 0 in 0.693s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-dcc11fb6-3508-4fa3-b7df-3074a06303c9" released by "_delete_snapshot" :: held 3.186s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" released by "delete_snapshot" :: held 3.210s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:18 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Created reservations ['b8704984-f950-40f9-8f8c-2bdd1b038b00', 'ffbd03be-fa25-4d13-9cb2-3a5a0e6a1a0d', 'fa00294d-cd28-4f51-9cfc-a73f9a2d75cf', 'd3b09ae3-83d8-4773-a45c-a8b1dd817e56'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:18 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:38:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f0a9dea4-a2df-405e-a9f2-e61f225979e7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-dcc11fb6-3508-4fa3-b7df-3074a06303c9-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-cf144119-3fc8-4134-84dd-b260a6b1c41f-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "cinder-cf144119-3fc8-4134-84dd-b260a6b1c41f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:19 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" acquired by "delete_volume" :: waited 0.019s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:20 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bb3547-aef9-408a-b781-ba121e54b192]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:20 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f Jul 08 11:38:20 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:20 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f" returned: 0 in 0.778s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:20 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:20 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f Jul 08 11:38:20 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:21 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-cf144119-3fc8-4134-84dd-b260a6b1c41f" returned: 0 in 0.661s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-cf144119-3fc8-4134-84dd-b260a6b1c41f" released by "delete_volume" :: held 1.515s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Created reservations ['9a1993d0-f07a-4ead-abe7-a4edd48dda7c', 'f8b494ec-921a-4927-9ed4-d00316577423', '425be335-c689-49c6-a1c9-03b8df7cbe21', '8dfeb003-5091-4739-9d34-6612b4d7a99a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:21 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:21 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:21 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:22 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.671s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:22 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2f6fc091-cb5d-4cc5-aab7-db46b5a532e6 tempest-ProjectMemberTests-872509998 None] Lock "cinder-cf144119-3fc8-4134-84dd-b260a6b1c41f-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6f67e738-381c-4999-ab25-8548698f7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a129a6b6-f764-4cb3-8e64-276127cb22f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a129a6b6-f764-4cb3-8e64-276127cb22f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818634992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c50604-09c0-485c-a1f7-0dca4c9a8e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:23Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423c136-af87-47b7-9fe2-b6db444561bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423c136-af87-47b7-9fe2-b6db444561bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630947e2-f4c4-4ca5-9a1f-79fc1baffe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630947e2-f4c4-4ca5-9a1f-79fc1baffe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c50604-09c0-485c-a1f7-0dca4c9a8e8e', 'volume_name': 'volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2217b21-779d-428d-8538-7d6971213b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2217b21-779d-428d-8538-7d6971213b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74233fcf-6a39-4828-9bac-3192d9e6d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:22 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Volume 41c50604-09c0-485c-a1f7-0dca4c9a8e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e', 'volume_size': 1} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818634992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c50604-09c0-485c-a1f7-0dca4c9a8e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:23Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Creating volume 41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:38:22 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:38:22 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:22 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e 1073741824 Jul 08 11:38:22 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:23 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e 1073741824" returned: 0 in 0.896s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:23 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:23 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e Jul 08 11:38:23 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:24 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" returned: 0 in 0.728s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74233fcf-6a39-4828-9bac-3192d9e6d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d0ced8-6089-447c-9d79-fb9b6949a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:24 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Volume volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e (41c50604-09c0-485c-a1f7-0dca4c9a8e8e): created successfully Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d0ced8-6089-447c-9d79-fb9b6949a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6f67e738-381c-4999-ab25-8548698f7220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:24 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-bc1a4047-1cbb-44d4-9149-7ae857aea190 tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Creating offline snapshot 8e3e2b35-a250-41f7-92b9-c35a33c52dba of volume 41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f4826-462e-4ec6-8520-6e1a33372315]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:24 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:25 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e Jul 08 11:38:25 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:25 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" returned: 0 in 0.771s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:25 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:25 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba 1G Jul 08 11:38:25 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:26 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba 1G" returned: 0 in 0.766s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:26 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:26 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba Jul 08 11:38:26 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:27 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba" returned: 0 in 0.680s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:27 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba is being set with open permissions: ugo+rw Jul 08 11:38:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:27 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba Jul 08 11:38:27 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:27 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba" returned: 0 in 0.622s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:27 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:27 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info Jul 08 11:38:27 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:28 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info" returned: 0 in 0.623s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:28 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info is being set with open permissions: ugo+rw Jul 08 11:38:28 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:28 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info Jul 08 11:38:28 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:29 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.info" returned: 0 in 0.617s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:29 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:29 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-68a55f03-b998-4916-b404-20ef405c088a tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-8e3e2b35-a250-41f7-92b9-c35a33c52dba-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-8e3e2b35-a250-41f7-92b9-c35a33c52dba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-8e3e2b35-a250-41f7-92b9-c35a33c52dba" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-8e3e2b35-a250-41f7-92b9-c35a33c52dba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot 8e3e2b35-a250-41f7-92b9-c35a33c52dba of volume 41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[456cc4fc-18c7-494c-adcb-f0e77ec262d7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:30 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba Jul 08 11:38:30 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:30 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba" returned: 0 in 0.724s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[89209895-3d0f-4491-95c9-0b564c102dbc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:30 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:31 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e Jul 08 11:38:31 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:31 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" returned: 0 in 0.725s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:31 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:31 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba Jul 08 11:38:31 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:32 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba" returned: 0 in 0.711s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:32 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:32 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba Jul 08 11:38:32 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:33 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e.8e3e2b35-a250-41f7-92b9-c35a33c52dba" returned: 0 in 0.632s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-8e3e2b35-a250-41f7-92b9-c35a33c52dba" released by "_delete_snapshot" :: held 2.874s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" released by "delete_snapshot" :: held 2.899s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Created reservations ['67f021fc-9f6a-411e-a8a4-489088e85594', 'fbc37121-fee4-448a-82ee-a975aa8bdd6e', '92b716f3-ed4c-47fd-9bf9-29b2f4e975f5', 'be997d20-c43d-4101-9dec-7420c07ea233'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:33 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-50c8adcb-ce74-4cb2-8d98-b07c30117d99 tempest-ProjectMemberTests-872509998 None] Lock "cinder-8e3e2b35-a250-41f7-92b9-c35a33c52dba-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-41c50604-09c0-485c-a1f7-0dca4c9a8e8e-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "cinder-41c50604-09c0-485c-a1f7-0dca4c9a8e8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[a430b10a-1747-491c-84cd-dd18dd2e8c0e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:33 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:33 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e Jul 08 11:38:33 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:34 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" returned: 0 in 0.741s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:34 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e Jul 08 11:38:34 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:34 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" returned: 0 in 0.637s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-41c50604-09c0-485c-a1f7-0dca4c9a8e8e" released by "delete_volume" :: held 1.430s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Created reservations ['e399fa85-1a11-46fd-891f-69b1213b9a06', 'dcb4ab25-ad16-40cf-8e76-72acebe364f4', '31a5e0ed-8a23-4d65-bb51-7381832a1d0e', '27db35a7-0dcd-4abe-8416-80cfe942703d'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:34 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:34 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:34 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:35 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:35 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e595bce8-c3f0-4aff-804b-74dd32db0197 tempest-ProjectMemberTests-872509998 None] Lock "cinder-41c50604-09c0-485c-a1f7-0dca4c9a8e8e-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (7243f31c-4558-4656-a30e-53814b577c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:35 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2adcfe-3bb4-408b-a0b3-69e5138fb4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2adcfe-3bb4-408b-a0b3-69e5138fb4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846466057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d702e9-d7e6-44d4-823b-cdb2d9803dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:36Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f518cfef-f811-4d3d-8485-b07bbccf48ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f518cfef-f811-4d3d-8485-b07bbccf48ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9064b4-57c2-4f27-b57f-9cc27d311abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9064b4-57c2-4f27-b57f-9cc27d311abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d702e9-d7e6-44d4-823b-cdb2d9803dc6', 'volume_name': 'volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9038101-f5a7-41af-a259-5f940006510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9038101-f5a7-41af-a259-5f940006510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eead20b-7b62-4e02-8cfa-79e1690a2849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:36 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Volume 84d702e9-d7e6-44d4-823b-cdb2d9803dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6', 'volume_size': 1} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846466057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d702e9-d7e6-44d4-823b-cdb2d9803dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:36Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Creating volume 84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:38:36 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:36 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 1073741824 Jul 08 11:38:36 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:36 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 1073741824" returned: 0 in 0.797s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:36 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:36 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 Jul 08 11:38:36 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:37 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" returned: 0 in 0.634s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eead20b-7b62-4e02-8cfa-79e1690a2849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e34779-566a-4c09-b840-c729c9af58f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:37 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Volume volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 (84d702e9-d7e6-44d4-823b-cdb2d9803dc6): created successfully Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e34779-566a-4c09-b840-c729c9af58f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:37 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (7243f31c-4558-4656-a30e-53814b577c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:37 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-74b1c5fd-1c9f-4761-9746-24d50a8f8503 tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot d995fe16-d113-43a5-a254-1830c6ecfb47 of volume 84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c542d769-25fd-41d1-9ccd-11b530880dbe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:38 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 Jul 08 11:38:38 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:38 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" returned: 0 in 0.740s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:38 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:38 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 1G Jul 08 11:38:38 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:39 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 1G" returned: 0 in 0.783s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:39 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:39 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 Jul 08 11:38:39 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:40 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47" returned: 0 in 0.684s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:40 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 is being set with open permissions: ugo+rw Jul 08 11:38:40 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:40 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 Jul 08 11:38:40 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:41 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47" returned: 0 in 0.623s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=105,cinder:UPDATE=127,cinder:DELETE=11,cinder:INSERT=37 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=98,cinder:INSERT=36,cinder:UPDATE=139,cinder:DELETE=10 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:41 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info Jul 08 11:38:41 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:41 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info" returned: 0 in 0.634s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:41 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info is being set with open permissions: ugo+rw Jul 08 11:38:41 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:41 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info Jul 08 11:38:41 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:42 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.info" returned: 0 in 0.643s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:42 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:42 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c0e7abc4-9d1a-46e8-a273-ed90003b1807 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-d995fe16-d113-43a5-a254-1830c6ecfb47-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-d995fe16-d113-43a5-a254-1830c6ecfb47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-d995fe16-d113-43a5-a254-1830c6ecfb47" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-d995fe16-d113-43a5-a254-1830c6ecfb47" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot d995fe16-d113-43a5-a254-1830c6ecfb47 of volume 84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e62195-6bb6-4232-b824-466f247ab3c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:43 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:43 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 Jul 08 11:38:43 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:44 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47" returned: 0 in 0.760s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc5cc8-d1a7-4e92-8458-78501f9375c8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:44 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 Jul 08 11:38:44 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:44 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" returned: 0 in 0.752s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:44 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:45 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 Jul 08 11:38:45 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:45 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:45 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:45 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47 Jul 08 11:38:45 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:46 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6.d995fe16-d113-43a5-a254-1830c6ecfb47" returned: 0 in 0.630s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-d995fe16-d113-43a5-a254-1830c6ecfb47" released by "_delete_snapshot" :: held 2.924s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" released by "delete_snapshot" :: held 2.943s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Created reservations ['2ad30ffd-5378-48cf-9b8a-a00957477e32', 'de3581d4-9418-4f58-96e5-ef8cf3dcecdb', 'f05a3240-e25a-4df0-ac21-50ccc1654a80', 'bf96d5a2-afac-41b1-ac81-2dd46b9ca764'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:46 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c10ccf39-ddd4-418c-8ac8-74b125c8185e tempest-ProjectMemberTests-872509998 None] Lock "cinder-d995fe16-d113-43a5-a254-1830c6ecfb47-delete_snapshot" released by "delete_snapshot" :: held 3.069s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-84d702e9-d7e6-44d4-823b-cdb2d9803dc6-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "cinder-84d702e9-d7e6-44d4-823b-cdb2d9803dc6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" acquired by "delete_volume" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f8a35-07c5-499b-9d24-d57eff68bfe9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:46 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:46 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 Jul 08 11:38:46 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:47 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" returned: 0 in 0.737s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:47 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:47 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6 Jul 08 11:38:47 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:48 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" returned: 0 in 0.620s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-84d702e9-d7e6-44d4-823b-cdb2d9803dc6" released by "delete_volume" :: held 1.407s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Created reservations ['0e3f4758-c27a-4ab0-bf91-6130d7ad1a50', '9ce1ad9f-2b7f-4f9d-9c05-690dda0a069e', 'db04d022-0046-44a3-bc5e-96035dea52a6', '2e143024-b92a-434f-8842-d9f7e25a87e8'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:48 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:48 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:48 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.616s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:48 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:38:48 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-f7dac495-5dcc-4492-b4bb-ac01d5cc4940 tempest-ProjectMemberTests-872509998 None] Lock "cinder-84d702e9-d7e6-44d4-823b-cdb2d9803dc6-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (be50cec3-1350-4115-8f0d-e52c3d561d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97936fa2-0e66-4aec-b2de-e024ecbe1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97936fa2-0e66-4aec-b2de-e024ecbe1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480828773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12710c0d-492e-4c11-a10f-6694032f227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:49Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03d0187-f255-458d-b4a8-811facc778b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03d0187-f255-458d-b4a8-811facc778b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdab4bd-1c1b-46af-8839-1a52f7a21940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdab4bd-1c1b-46af-8839-1a52f7a21940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12710c0d-492e-4c11-a10f-6694032f227a', 'volume_name': 'volume-12710c0d-492e-4c11-a10f-6694032f227a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d62bba-8257-4cdb-8052-bfa21ad6f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d62bba-8257-4cdb-8052-bfa21ad6f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebcc14-93c2-44d1-9eae-ae2884183f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:49 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Volume 12710c0d-492e-4c11-a10f-6694032f227a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12710c0d-492e-4c11-a10f-6694032f227a', 'volume_size': 1} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480828773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12710c0d-492e-4c11-a10f-6694032f227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:38:49Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Creating volume 12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:38:49 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:38:49 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:49 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a 1073741824 Jul 08 11:38:49 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:50 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a 1073741824" returned: 0 in 0.773s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:50 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a Jul 08 11:38:50 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:50 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a" returned: 0 in 0.631s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebcc14-93c2-44d1-9eae-ae2884183f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12710c0d-492e-4c11-a10f-6694032f227a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b594fd-d4e7-4a98-83db-1e21da2e07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:38:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Volume volume-12710c0d-492e-4c11-a10f-6694032f227a (12710c0d-492e-4c11-a10f-6694032f227a): created successfully Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b594fd-d4e7-4a98-83db-1e21da2e07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:38:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (be50cec3-1350-4115-8f0d-e52c3d561d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:38:50 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-4ed4ac12-ddc5-4724-b513-7cf3b222a25f tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:38:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:51 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot 5a89dca3-4cfa-40ed-adc4-4f70327131f0 of volume 12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:38:51 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf2ccf6-700b-4569-88ce-4ab30820ce11]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:51 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a Jul 08 11:38:51 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:52 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a" returned: 0 in 0.727s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:52 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 1G Jul 08 11:38:52 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:52 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:38:52 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:52 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:52 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.621s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 1G" returned: 0 in 0.796s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12710c0d-492e-4c11-a10f-6694032f227a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:38:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:38:52 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12710c0d-492e-4c11-a10f-6694032f227a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 Jul 08 11:38:52 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:53 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12710c0d-492e-4c11-a10f-6694032f227a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:53 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 is being set with open permissions: ugo+rw Jul 08 11:38:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:53 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 Jul 08 11:38:53 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:54 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0" returned: 0 in 0.623s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:54 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info Jul 08 11:38:54 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:54 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info" returned: 0 in 0.646s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:54 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info is being set with open permissions: ugo+rw Jul 08 11:38:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:54 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info Jul 08 11:38:54 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:55 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.info" returned: 0 in 0.620s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.143s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:38:55 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-ef51ae58-4de5-4a2d-828c-ca08e5244681 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-5a89dca3-4cfa-40ed-adc4-4f70327131f0-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-5a89dca3-4cfa-40ed-adc4-4f70327131f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-5a89dca3-4cfa-40ed-adc4-4f70327131f0" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5a89dca3-4cfa-40ed-adc4-4f70327131f0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot 5a89dca3-4cfa-40ed-adc4-4f70327131f0 of volume 12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de03d4-8687-4bf2-b504-4ce2e767b9f4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:56 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 Jul 08 11:38:56 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:57 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:57 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12710c0d-492e-4c11-a10f-6694032f227a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:38:57 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9bb215-4c8a-4a83-b1fe-251f4688558f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:57 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a Jul 08 11:38:57 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:58 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a" returned: 0 in 0.755s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:58 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 Jul 08 11:38:58 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:58 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0" returned: 0 in 0.717s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:58 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0 Jul 08 11:38:58 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:38:59 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a.5a89dca3-4cfa-40ed-adc4-4f70327131f0" returned: 0 in 0.620s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-5a89dca3-4cfa-40ed-adc4-4f70327131f0" released by "_delete_snapshot" :: held 2.921s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" released by "delete_snapshot" :: held 2.946s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Created reservations ['18a198fd-692b-464b-a277-bdd096e53828', 'b7ed04e1-dd53-4082-8cc6-752edc17aa3f', '5f55185e-cb23-4030-bda4-926d7a971305', '306cd686-90bb-4036-bad9-dca5cc271cf6'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:38:59 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-c889b521-27b6-4a59-86ac-937cf15580b9 tempest-ProjectMemberTests-872509998 None] Lock "cinder-5a89dca3-4cfa-40ed-adc4-4f70327131f0-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-12710c0d-492e-4c11-a10f-6694032f227a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "cinder-12710c0d-492e-4c11-a10f-6694032f227a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" acquired by "delete_volume" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[1228fc04-85b4-466e-9236-f3333d468307]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:38:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:38:59 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a Jul 08 11:39:00 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:00 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a" returned: 0 in 0.747s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:00 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a Jul 08 11:39:00 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:01 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-12710c0d-492e-4c11-a10f-6694032f227a" returned: 0 in 0.623s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-12710c0d-492e-4c11-a10f-6694032f227a" released by "delete_volume" :: held 1.424s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Created reservations ['151626e2-5288-4efd-8d61-106f1cefd467', 'f3e7def7-9ab4-464e-8479-519acd76983b', '0c3a8fa3-7d3b-424f-a006-b7e65571f5d1', '268ab62b-5a3f-495b-8b77-1921a5c77327'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:01 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:01 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:39:01 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:02 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:39:02 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-32c2b7fa-5652-4733-bfff-840d07899cfc tempest-ProjectMemberTests-872509998 None] Lock "cinder-12710c0d-492e-4c11-a10f-6694032f227a-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6f5b2343-d447-4c58-b292-26d05c6f8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d7a100-c5a0-4c4f-b992-007aeb7f611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d7a100-c5a0-4c4f-b992-007aeb7f611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81686194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee33b4b-60c3-4533-91f2-ce3f8502e8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:39:02Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffe83c-601b-4683-8511-ebc40e8d64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffe83c-601b-4683-8511-ebc40e8d64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d317c15-25ec-4634-900b-5af44671615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d317c15-25ec-4634-900b-5af44671615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee33b4b-60c3-4533-91f2-ce3f8502e8e1', 'volume_name': 'volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe30b7-bfd3-42be-9b6a-02fbfb7c002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe30b7-bfd3-42be-9b6a-02fbfb7c002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77bc579-11ce-474a-8993-6fbbca52cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:02 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Volume 2ee33b4b-60c3-4533-91f2-ce3f8502e8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1', 'volume_size': 1} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81686194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee33b4b-60c3-4533-91f2-ce3f8502e8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79287f5018e45e49b0328cead5c4e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:39:02Z,use_quota=True,user_id='86c30be871f04151a946bc7d836f75b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Creating volume 2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:39:02 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:39:02 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:02 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 1073741824 Jul 08 11:39:02 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:03 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 1073741824" returned: 0 in 0.803s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:03 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 Jul 08 11:39:03 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:03 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" returned: 0 in 0.625s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77bc579-11ce-474a-8993-6fbbca52cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:03 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617be624-03e4-44ef-aebb-132303d4d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:04 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Volume volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 (2ee33b4b-60c3-4533-91f2-ce3f8502e8e1): created successfully Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617be624-03e4-44ef-aebb-132303d4d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Flow 'volume_create_manager' (6f5b2343-d447-4c58-b292-26d05c6f8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:39:04 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3a6fe25a-8813-49d9-8568-e49397e1132c tempest-ProjectMemberTests-872509998 None] Created volume successfully. Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Creating offline snapshot 8d00ce65-fc1d-41b4-88ad-ea69123f95bd of volume 2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eecc3ee-91b4-4acd-a270-b5ff3a3a6c84]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:04 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 Jul 08 11:39:04 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:05 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" returned: 0 in 0.738s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:05 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd 1G Jul 08 11:39:05 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:06 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd 1G" returned: 0 in 0.789s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:06 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd Jul 08 11:39:06 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:06 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd" returned: 0 in 0.659s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:06 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd is being set with open permissions: ugo+rw Jul 08 11:39:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:06 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd Jul 08 11:39:06 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:07 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd" returned: 0 in 0.621s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:07 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info Jul 08 11:39:07 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:08 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info" returned: 0 in 0.631s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:08 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info is being set with open permissions: ugo+rw Jul 08 11:39:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:08 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info Jul 08 11:39:08 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:08 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.info" returned: 0 in 0.630s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:08 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-95e47f25-94a9-4ac8-b77c-c68110fdda53 tempest-ProjectMemberTests-872509998 None] Create snapshot completed successfully Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-8d00ce65-fc1d-41b4-88ad-ea69123f95bd-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-8d00ce65-fc1d-41b4-88ad-ea69123f95bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-8d00ce65-fc1d-41b4-88ad-ea69123f95bd" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-8d00ce65-fc1d-41b4-88ad-ea69123f95bd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Deleting offline snapshot 8d00ce65-fc1d-41b4-88ad-ea69123f95bd of volume 2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] snapshot_file for this snap is: volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd0cd15-349c-48bc-80e0-093b2547d458]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:10 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd Jul 08 11:39:10 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:10 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd" returned: 0 in 0.735s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:10 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:39:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[040346f2-4955-41b8-9a67-7f5d86f87066]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:10 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 Jul 08 11:39:10 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:11 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" returned: 0 in 0.718s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:11 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd Jul 08 11:39:11 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:12 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd" returned: 0 in 0.699s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:12 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd Jul 08 11:39:12 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:12 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1.8d00ce65-fc1d-41b4-88ad-ea69123f95bd" returned: 0 in 0.621s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-8d00ce65-fc1d-41b4-88ad-ea69123f95bd" released by "_delete_snapshot" :: held 2.854s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" released by "delete_snapshot" :: held 2.875s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Created reservations ['9a8db703-7cfb-4aff-a5a7-26c61550976b', '8cdec12e-c4b8-40a0-bd1f-48be9f627d5b', '495c13ad-91a4-4ed4-ac06-086ab3afe34c', '7c226e09-04ea-4a4f-8f80-971eeadcb7fc'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:39:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Delete snapshot completed successfully. Jul 08 11:39:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-a7550fb0-9300-4ade-a0d3-bdfcd6ccd7bc tempest-ProjectMemberTests-872509998 None] Lock "cinder-8d00ce65-fc1d-41b4-88ad-ea69123f95bd-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48999c2-ab06-4a0e-a14c-6570938309a5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:13 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 Jul 08 11:39:13 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:13 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" returned: 0 in 0.723s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:13 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1 Jul 08 11:39:13 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:14 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" returned: 0 in 0.633s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-quobyte-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1" released by "delete_volume" :: held 1.409s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Created reservations ['47b0f8fc-b0c9-4d9b-9eae-8cde7343cbd4', 'dcdd1e6b-2aff-4b08-9ba5-a3480a05d434', '80120377-105a-4de8-a8c2-65ff2c876452', '454e2131-d717-4dbd-964c-3d7ec7c7bb16'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:14 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:39:14 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:15 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:15 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.650s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:15 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:39:15 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Deleted volume successfully. Jul 08 11:39:15 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-3e2d9dde-384b-4f85-a094-45e9bf4c1ca7 tempest-ProjectMemberTests-872509998 None] Lock "cinder-2ee33b4b-60c3-4533-91f2-ce3f8502e8e1-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:39:24 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:39:25 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=33,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=6 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Flow 'volume_create_manager' (4b9845d8-3766-4ea2-853e-0d5ecca5d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d0291-35f5-43fd-a2ca-dfb3c02f2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d0291-35f5-43fd-a2ca-dfb3c02f2b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-671808486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cdea27-3dfc-4e17-a20d-92611d87635a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c39af0fc0254a42bc86c7900d4cd9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:39:51Z,use_quota=True,user_id='4382bc3ec40847c69156e01becafc359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb206b-70a0-4a06-b57a-36dc5babf844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb206b-70a0-4a06-b57a-36dc5babf844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb9f47e-68f2-4a35-ab79-696b8a7a2812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb9f47e-68f2-4a35-ab79-696b8a7a2812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cdea27-3dfc-4e17-a20d-92611d87635a', 'volume_name': 'volume-f5cdea27-3dfc-4e17-a20d-92611d87635a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e95a4ed-11d2-4ca4-bb3f-e43086fba9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e95a4ed-11d2-4ca4-bb3f-e43086fba9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf5f198-53a0-4c8b-9867-3ec831e7c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:50 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Volume f5cdea27-3dfc-4e17-a20d-92611d87635a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cdea27-3dfc-4e17-a20d-92611d87635a', 'volume_size': 1} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-671808486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cdea27-3dfc-4e17-a20d-92611d87635a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c39af0fc0254a42bc86c7900d4cd9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:39:51Z,use_quota=True,user_id='4382bc3ec40847c69156e01becafc359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)}" {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Creating volume f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:39:50 devstack cinder-volume[86852]: INFO cinder.volume.drivers.remotefs [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] casted to osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 Jul 08 11:39:50 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a 1073741824 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:50 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a 1073741824 Jul 08 11:39:50 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:51 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a 1073741824" returned: 0 in 0.792s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:51 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:51 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:39:51 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:52 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.654s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'} {{(pid=86852) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf5f198-53a0-4c8b-9867-3ec831e7c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cdea27-3dfc-4e17-a20d-92611d87635a', 'volume_size': 1}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7324123d-990b-4b96-b987-898ef6fd16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:52 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Volume volume-f5cdea27-3dfc-4e17-a20d-92611d87635a (f5cdea27-3dfc-4e17-a20d-92611d87635a): created successfully Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7324123d-990b-4b96-b987-898ef6fd16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Flow 'volume_create_manager' (4b9845d8-3766-4ea2-853e-0d5ecca5d08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:39:52 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fcdfcf9c-16e0-46e2-a662-f8203133d1b7 tempest-SnapshotDependencyTests-345250154 None] Created volume successfully. Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:52 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:39:52 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Creating offline snapshot 9039857c-eb99-4fe8-a02c-48ba33623f93 of volume f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6ff4b-fc76-4b6c-affe-c212952812ce]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:52 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.658s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG oslo_service.periodic_task [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] Running periodic task VolumeManager._thread_info {{(pid=86852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread count: 29 {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 11:39:52 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-7c802d6e-3c1d-4855-a163-ece9c443866a None None] thread info: [<_MainThread(MainThread, started 132363756105856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 11:39:53 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:39:53 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:53 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.743s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:53 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 1G {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:53 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 1G Jul 08 11:39:53 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:54 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 1G" returned: 0 in 0.793s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:54 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cdea27-3dfc-4e17-a20d-92611d87635a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:54 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cdea27-3dfc-4e17-a20d-92611d87635a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:39:54 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:55 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cdea27-3dfc-4e17-a20d-92611d87635a -F qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.683s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:55 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 is being set with open permissions: ugo+rw Jul 08 11:39:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:55 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:39:55 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:55 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.613s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:55 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:55 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info Jul 08 11:39:55 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:56 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info" returned: 0 in 0.651s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:56 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info is being set with open permissions: ugo+rw Jul 08 11:39:56 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:56 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info Jul 08 11:39:56 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:57 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.info" returned: 0 in 0.624s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:57 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:57 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fce43d59-7e21-4e0e-9215-fe964853ebfb tempest-SnapshotDependencyTests-345250154 None] Create snapshot completed successfully Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86852) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Flow 'volume_create_manager' (286c5d7a-9e84-4eab-996e-6c47d846ff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67b113a-688f-4e7e-9dee-2426b1b525b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67b113a-688f-4e7e-9dee-2426b1b525b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T09:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00bc554-641e-43b3-bc40-1a9a1ddef953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c39af0fc0254a42bc86c7900d4cd9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T09:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9039857c-eb99-4fe8-a02c-48ba33623f93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T09:39:59Z,use_quota=True,user_id='4382bc3ec40847c69156e01becafc359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b85eebf4-cd4a-47e2-92dc-71b842e35579),volume_type_id=b85eebf4-cd4a-47e2-92dc-71b842e35579)' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cc8678-5507-4c74-960e-63918414fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51cc8678-5507-4c74-960e-63918414fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296813f0-645a-41e5-8d8c-2d594d39d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296813f0-645a-41e5-8d8c-2d594d39d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd00bc554-641e-43b3-bc40-1a9a1ddef953', 'volume_name': 'volume-d00bc554-641e-43b3-bc40-1a9a1ddef953', 'volume_size': 1, 'snapshot_id': '9039857c-eb99-4fe8-a02c-48ba33623f93'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebac100-9647-41b6-b2ac-176c5339f205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebac100-9647-41b6-b2ac-176c5339f205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79d8efc-1314-409e-acee-11d8923b53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:39:58 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Volume d00bc554-641e-43b3-bc40-1a9a1ddef953: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d00bc554-641e-43b3-bc40-1a9a1ddef953', 'volume_size': 1, 'snapshot_id': '9039857c-eb99-4fe8-a02c-48ba33623f93'} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93-d00bc554-641e-43b3-bc40-1a9a1ddef953" by "_create_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93-d00bc554-641e-43b3-bc40-1a9a1ddef953" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Creating volume d00bc554-641e-43b3-bc40-1a9a1ddef953 from snapshot 9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Selected osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30 as target Quobyte volume. {{(pid=86852) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" by "_copy_volume_from_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] snapshot: 9039857c-eb99-4fe8-a02c-48ba33623f93, volume: d00bc554-641e-43b3-bc40-1a9a1ddef953, {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[0622918c-aba6-4072-8eda-7020df89791a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:58 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:58 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:39:58 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:39:59 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5cdea27-3dfc-4e17-a20d-92611d87635a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] will copy from snapshot at /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Creating direct copy from snapshot {{(pid=86852) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[947c54f1-7e67-49e2-9b26-08c2ad0d09f6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:39:59 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:39:59 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:39:59 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:00 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.748s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:00 devstack cinder-volume[86852]: DEBUG cinder.utils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Path /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 not found in is_blk_device check {{(pid=86852) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 11:40:00 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:00 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 Jul 08 11:40:00 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:04 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953" returned: 0 in 4.354s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:04 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8651fb-73bf-4e6d-99f2-67d786925dda]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:40:04 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:04 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:40:04 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:05 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.905s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:05 devstack cinder-volume[86852]: DEBUG cinder.image.image_utils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Image conversion details: src /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 {{(pid=86852) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 11:40:05 devstack cinder-volume[86852]: INFO cinder.image.image_utils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Converted 1024.00 MB image at 235.14 MB/s Jul 08 11:40:05 devstack cinder-volume[86852]: WARNING cinder.volume.drivers.remotefs [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 is being set with open permissions: ugo+rw Jul 08 11:40:05 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:05 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 Jul 08 11:40:05 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:06 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953" returned: 0 in 0.628s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" released by "_copy_volume_from_snapshot" :: held 7.466s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93-d00bc554-641e-43b3-bc40-1a9a1ddef953" released by "_create_volume_from_snapshot" :: held 7.494s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.508s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79d8efc-1314-409e-acee-11d8923b53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00bc554-641e-43b3-bc40-1a9a1ddef953', 'volume_size': 1, 'snapshot_id': '9039857c-eb99-4fe8-a02c-48ba33623f93'}' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ed62c-1acc-4e56-8f6c-daf5a0412d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 11:40:06 devstack cinder-volume[86852]: INFO cinder.volume.flows.manager.create_volume [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Volume volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 (d00bc554-641e-43b3-bc40-1a9a1ddef953): created successfully Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ed62c-1acc-4e56-8f6c-daf5a0412d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86852) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 11:40:06 devstack cinder-volume[86852]: DEBUG cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Flow 'volume_create_manager' (286c5d7a-9e84-4eab-996e-6c47d846ff43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86852) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 11:40:06 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-e6cb99d3-f7e0-46f0-a760-25651e06e591 tempest-SnapshotDependencyTests-345250154 None] Created volume successfully. Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-9039857c-eb99-4fe8-a02c-48ba33623f93-delete_snapshot" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-9039857c-eb99-4fe8-a02c-48ba33623f93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" by "delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93" by "_delete_snapshot" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Deleting offline snapshot 9039857c-eb99-4fe8-a02c-48ba33623f93 of volume f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] snapshot_file for this snap is: volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae21373e-2656-45b1-8328-c221118f1e3f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:40:07 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:07 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:40:07 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:08 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.728s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.remotefs [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5cdea27-3dfc-4e17-a20d-92611d87635a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86852) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ce29c-c68d-4382-a820-be081f970e30]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:08 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:40:08 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:08 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.732s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:08 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:08 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:40:08 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:09 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.709s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:09 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:09 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93 Jul 08 11:40:09 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:10 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a.9039857c-eb99-4fe8-a02c-48ba33623f93" returned: 0 in 0.628s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-9039857c-eb99-4fe8-a02c-48ba33623f93" released by "_delete_snapshot" :: held 2.884s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" released by "delete_snapshot" :: held 2.904s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Created reservations ['4660fe54-74a1-4fd3-bec9-3dff987a55db', 'be830fbc-530c-485e-bc8c-2e41d9739f8a', '3bdc3312-067e-4f52-ae66-7b581b3c4d85', '0c97067c-f16e-4953-b213-77c068ebcc8a'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:40:10 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Delete snapshot completed successfully. Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-2ec86ac7-d792-44b7-a884-f2c6267f475f tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-9039857c-eb99-4fe8-a02c-48ba33623f93-delete_snapshot" released by "delete_snapshot" :: held 3.025s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-f5cdea27-3dfc-4e17-a20d-92611d87635a-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-f5cdea27-3dfc-4e17-a20d-92611d87635a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" acquired by "delete_volume" :: waited 0.014s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[179049d2-7553-4258-8493-f6cb99acce9f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:40:10 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:10 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:40:10 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:11 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.741s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:11 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a Jul 08 11:40:11 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:11 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:11 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-f5cdea27-3dfc-4e17-a20d-92611d87635a" returned: 0 in 0.640s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:11 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-f5cdea27-3dfc-4e17-a20d-92611d87635a" released by "delete_volume" :: held 1.433s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Created reservations ['d458315d-a9cf-45fa-b018-343128a9c444', '1db4f144-fc2b-4f98-ac59-34c5771b88df', '5464a0ec-92e4-43af-9db8-e7cc7065e9e7', '6817057f-2dbb-4e23-a481-39b46169ce89'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:12 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:40:12 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-d00bc554-641e-43b3-bc40-1a9a1ddef953-delete_volume" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-d00bc554-641e-43b3-bc40-1a9a1ddef953-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:12 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.664s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" by "delete_volume" {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 11:40:12 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Deleted volume successfully. Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" acquired by "delete_volume" :: waited 0.021s {{(pid=86852) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-fdcc1583-1b88-4e98-966a-2e2a68488420 tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-f5cdea27-3dfc-4e17-a20d-92611d87635a-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo.privsep.daemon [-] privsep: reply[949af85d-f3a4-4830-8e17-36d1bf7ee1b8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 11:40:12 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:12 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 Jul 08 11:40:12 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:13 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953" returned: 0 in 0.746s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:13 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:13 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953 Jul 08 11:40:13 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:14 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b/volume-d00bc554-641e-43b3-bc40-1a9a1ddef953" returned: 0 in 0.648s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-quobyte-d00bc554-641e-43b3-bc40-1a9a1ddef953" released by "delete_volume" :: held 1.435s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.quota [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Created reservations ['d4abb334-030b-471e-a0ee-e7847520a9ba', 'df63bca1-e3d0-4a5f-a30d-ba401ba5f6a6', '659facaa-da7f-43c0-88a6-e6b7bfaf0d9b', 'e2b72443-d019-4187-ad3b-3ef8c0af7212'] {{(pid=86852) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30': None} {{(pid=86852) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.volume.drivers.quobyte [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fddd3cec-e721-46d7-b289-35000d8a8d30'] {{(pid=86852) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.lockutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86852) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 11:40:14 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b Jul 08 11:40:14 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 11:40:14 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG oslo_concurrency.processutils [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/065758a83a8e398868a8504406866b6b" returned: 0 in 0.636s {{(pid=86852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.manager [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Notifying Schedulers of capabilities ... {{(pid=86852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 11:40:14 devstack cinder-volume[86852]: INFO cinder.volume.manager [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Deleted volume successfully. Jul 08 11:40:14 devstack cinder-volume[86852]: DEBUG cinder.coordination [None req-b8d8dd26-7d67-4e68-b3d6-5d05feea0dbb tempest-SnapshotDependencyTests-345250154 None] Lock "cinder-d00bc554-641e-43b3-bc40-1a9a1ddef953-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86852) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 11:40:24 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 11:40:24 devstack cinder-volume[86852]: DEBUG dbcounter [-] [86852] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}